Bulk check the number of indexed pages

3 replies
I have a list of around 100,000 domains and I'm looking for a way to bulk check the number of indexed pages that each domain has.

Does anybody know a way in which I can do this quickly or any sort of software that will be able to do this for me?

Thanks
#bulk #check #indexed #number #pages
  • Profile picture of the author dspa72
    100,000 domains?
    Well, I think that you need to know the indexed pages on google, right?
    This means that you should query google "site:yourdomain" for 100,000 times, and google will ban your ip or similar thing. Well, I don't know of any software that can do that on so many domains. Good luck
    {{ DiscussionBoard.errors[8152580].message }}
    • Profile picture of the author jackc2107
      Originally Posted by dspa72 View Post

      100,000 domains?
      Well, I think that you need to know the indexed pages on google, right?
      This means that you should query google "site:yourdomain" for 100,000 times, and google will ban your ip or similar thing. Well, I don't know of any software that can do that on so many domains. Good luck
      Yep it took a lot of scraping but once I find out how to check for the indexed pages it will be worth it.
      I don't really fancy doing 100,000 searches though
      And yes it is the number of indexed pages on google
      {{ DiscussionBoard.errors[8152593].message }}
      • Profile picture of the author Steve B
        Jack,

        The term "scraping" sets off a red flag in my mind. What kind of evil project are you working on, LOL!

        I know there is software that checks for the number of indexed pages of dropped domains. I don't know how it works but I'm guessing that it does what you're after. The software "spits out" reports on thousands of expired domains every day so I'm guessing the creators of the software have figured out how to send "bulk" inquiries without getting banned by the Big G.

        Steve
        Signature

        Steve Browne, online business strategies, tips, guidance, and resources
        SteveBrowneDirect

        {{ DiscussionBoard.errors[8153778].message }}

Trending Topics