Need a program that will export or scrape Google Search Results

by ToddAP79 Posted: 14 years ago 2 replies

i am looking for a program that will scrape or export a list of the Google Search Results so i can import them into a program i wrote.

i am currently using Accurate Monitor for Search Engines but it doesn't automate well.

any help would be nice thank you.

#programming #export #google #program #results #scrape #search

Nochek 14 years ago

I wrote one once out of C#, but I never got around to making it work for the public. Frankly, fighting their anti-bot measures is a pain in the butt, and paying for their API calls quickly makes it not worth the time.
- [1] reply
- freehugs 14 years ago
  
  I had pretty good success using yahoo pipes for simple data retrieval.
  
  If you want to code something, Mechanize and Nokogiri are both excellent libraries for Ruby. BeautifulSoup is a great document parsing library for Python. There are also bindings for Selenium-webdriver in many languages if you need to 'drive' an instance of Chrome or Firefox (necessary if you need to be able to run Javascript).

Join the discussion

Next Topics on Trending Feed

3

Need a program that will export or scrape Google Search Results

ToddAP79 • 14 years ago • 2 replies

i am looking for a program that will scrape or export a list of the Google Search Results so i can import them into a program i wrote. i am currently using Accurate Monitor for Search Engines but it doesn't automate well.