13 {{ upvoteCount | shortNum }}
13 {{ upvoteCount | shortNum }}

google url scraper

by Wage Mills
9 replies
does anyone one a good free?
#google #scraper #url
  • Profile picture of the author socialmediawarrior
    Scraping Google search results is against their terms of service. You are better off using a tool / service that uses the Google API. Since, they no longer offer new API keys, you may want to find / talk to someone that already has a key to their API.
    Signature
    Online Twitter Marketing Software Dashboard

    Manage Multiple Twitter Accounts on Autopilot

    Twitter Automation Software - Special Offer
    {{ DiscussionBoard.errors[2257304].message }}
  • Profile picture of the author AndyBeard
    You can scrape Google search results with....

    Google Docs

    That isn't against their ToS, because they even list that as an example within their Google Doc online instructions.

    API data isn't very useful as the rankings are different.

    Another fairly unique resource is a Firefox plugin called Outwit
    Signature
    uQast In A Nutshell
    {{ DiscussionBoard.errors[2257351].message }}
    • Profile picture of the author Michael Mayo
      Originally Posted by AndyBeard View Post

      Another fairly unique resource is a Firefox plugin called Outwit
      Wow! Now that's sweet!

      Thanks,
      Have a Great Day!
      Michael
      {{ DiscussionBoard.errors[2257570].message }}
  • Profile picture of the author ChrisBa
    Check out CPV Den, under the "free tools" section they have a free google url scraper...
    Signature
    {{ DiscussionBoard.errors[2257517].message }}
  • Profile picture of the author Wage Mills
    how do you use google docs?
    {{ DiscussionBoard.errors[2257542].message }}
  • Profile picture of the author ADAMw3
    Scrapebox is amazing at this. It costs $50-97. Some of the best money you'll ever spend if you're into CPV traffic.
    {{ DiscussionBoard.errors[2257832].message }}
  • Profile picture of the author Wage Mills
    outwit doesnt let you save the urls in a regular format
    {{ DiscussionBoard.errors[2257940].message }}
  • Profile picture of the author Aaron Cross
    hey hey, I'm just getting back into ppv.. about a year ago I had a url scraper that worked right off of google's search bar. If you went to google.com there would be 3 buttons: Google search, feeling lucky and scrape url..

    All you had to do was type in the domain and hit scrape and it would produce almost like a blank doc. (within the browser but it was blank/not a google branded page) with all the urls/links within that domain.

    Having quite a time finding it again... does anyone know what prog/add on im talking about here?

    You'd be a life saver!

    Thanks!


    Pretty much the same thing as searching 'keyword' site:domain.com except it put it in an easy copy and paste "notepad" format

    domain.com
    domain.com/about
    domain.com/etc
    {{ DiscussionBoard.errors[4322962].message }}
    • Profile picture of the author ZachOlander
      Originally Posted by Aaron Cross View Post

      hey hey, I'm just getting back into ppv.. about a year ago I had a url scraper that worked right off of google's search bar. If you went to google.com there would be 3 buttons: Google search, feeling lucky and scrape url..

      All you had to do was type in the domain and hit scrape and it would produce almost like a blank doc. (within the browser but it was blank/not a google branded page) with all the urls/links within that domain.

      Having quite a time finding it again... does anyone know what prog/add on im talking about here?

      You'd be a life saver!

      Thanks!


      Pretty much the same thing as searching 'keyword' site:domain.com except it put it in an easy copy and paste "notepad" format

      domain.com
      domain.com/about
      domain.com/etc
      I know this was posted a little while ago but in case you did not figure out the browser add on you were looking for its, called "google url harvester".

      Hope this helps.
      {{ DiscussionBoard.errors[4748234].message }}

Trending Topics