3 replies
I need to scrape several sites and pull product titles for a few PPC clients I'm consulting so I'm on the market for a spider or crawler program, preferably one that works on Ubuntu Linux. Do you have any suggestions?

Thanks in advance,
#hungry #spider
  • Profile picture of the author blur
    Is this for a one time scraping or scraping consistently?

    {{ DiscussionBoard.errors[1415726].message }}
    • Profile picture of the author davidmerrick
      Just a one time scraping of each site I need to scrape.
      {{ DiscussionBoard.errors[1415781].message }}
      • Profile picture of the author davidmerrick
        I'm using the OutWit Hub plugin for Firefox right now and it works well but doesn't follow the links. Does anyone have a spider, crawler, or scraper program that they use or even know of?
        {{ DiscussionBoard.errors[1416157].message }}

Trending Topics