15 {{ upvoteCount | shortNum }}
15 {{ upvoteCount | shortNum }}

Mass domain deindex checker?

by danparks
12 replies
  • SEO
    • |
Does anyone know of a good tool (standalone or web-based) for checking many domains to see which are deindexed?

I know of a couple, but they give too many false positives. For instance, Bulk Google Index Checker - Free Bulk Index Checker - Tool for Bulk Index Checking lets you enter 25 domains at a time (I'd like to enter more domains, but I'm okay with running a checker several times), but each running showed several domains as deindexed, when I know for a fact they aren't deindexed.
#checker #deindex #domain #mass
  • Profile picture of the author MikeFriedman
    Scrapebox will do it.
    Signature

    For SEO news, discussions, tactics, and more.
    {{ DiscussionBoard.errors[9548006].message }}
    • Profile picture of the author danparks
      Originally Posted by MikeFriedman View Post

      Scrapebox will do it.
      I had heard that. But I also heard more than once that this too resulted in a lot of false positives for deindexing.

      I have Scrapebox. Any online resource for how to use it for this purpose? Ideally I'd like to just be able to import a text file of domains and run at check.
      {{ DiscussionBoard.errors[9548033].message }}
      • Profile picture of the author MikeFriedman
        Originally Posted by danparks View Post

        I have Scrapebox. Any online resource for how to use it for this purpose? Ideally I'd like to just be able to import a text file of domains and run at check.
        No need for an online resource. It is two steps.

        Click "Import URL" list and either import from the clipboard or a file.

        Click "Check Indexed". Select "Google Indexed" or "Bing Indexed".

        Done.
        Signature

        For SEO news, discussions, tactics, and more.
        {{ DiscussionBoard.errors[9548085].message }}
      • Profile picture of the author nik0
        Banned
        Originally Posted by danparks View Post

        I had heard that. But I also heard more than once that this too resulted in a lot of false positives for deindexing.

        I have Scrapebox. Any online resource for how to use it for this purpose? Ideally I'd like to just be able to import a text file of domains and run at check.
        Scrapebox indeed gives false results (has to do with www. and non www. btw) same like that online tool that you use, so I always combine the two of them.

        Earlier my internet was so slow that I couldn't even use Scrapebox and then I just relied on that online tool, however when it shows as deindexed I always do a manual site: command to make sure it's really deindexed as indeed it gives false outcomes on regular base.

        Sometimes it also seems the tool is over used and then everything shows as either indexed or not indexed (forgot what status it was) and then it's just a matter of waiting 10-20 seconds and try again.
        {{ DiscussionBoard.errors[9549151].message }}
        • Profile picture of the author danparks
          Originally Posted by nik0 View Post

          Sometimes it also seems the tool is over used and then everything shows as either indexed or not indexed (forgot what status it was) and then it's just a matter of waiting 10-20 seconds and try again.
          I saw that too. Some said not indexed, some showed a dash like it couldn't be determined. Many seconds later, the "indexed" results popped into place, without me doing anything.

          I intentionally entered a few domains that I knew were deindexed, along with many that weren't, for a test. It got them all correct. Though I would still double-check any "deindexed" listings in the future just to make sure.
          {{ DiscussionBoard.errors[9549193].message }}
          • Profile picture of the author MikeFriedman
            Originally Posted by danparks View Post

            I saw that too. Some said not indexed, some showed a dash like it couldn't be determined. Many seconds later, the "indexed" results popped into place, without me doing anything.
            My guess when you see results like that with a tool of that sort is it did the inquiry with a proxy that was dead.
            Signature

            For SEO news, discussions, tactics, and more.
            {{ DiscussionBoard.errors[9549247].message }}
            • Profile picture of the author yukon
              Banned
              Originally Posted by MikeFriedman View Post

              My guess when you see results like that with a tool of that sort is it did the inquiry with a proxy that was dead.
              Agreed, Google is looking at the same IP running non-stop site:domain searches which throws a captcha warning on a manual SERP search. The only way around the captcha is a list of fresh proxies.
              {{ DiscussionBoard.errors[9549344].message }}
  • Profile picture of the author danparks
    That was easy. Guess I'll have to start firing up Scrapebox more often and start using it!
    {{ DiscussionBoard.errors[9548163].message }}
  • Profile picture of the author sweezeter
    Get yourself a set of nice private proxies and false negatives won't be a problem.

    At the very least you can find the links that were "deindexed" and check yourself.

    Couldn't you also do a PR lookup on the domain? Won't deindexed domains throw a PR NA nearly right away?
    {{ DiscussionBoard.errors[9549533].message }}
    • Profile picture of the author MikeFriedman
      Originally Posted by sweezeter View Post

      Get yourself a set of nice private proxies and false negatives won't be a problem.

      At the very least you can find the links that were "deindexed" and check yourself.

      Couldn't you also do a PR lookup on the domain? Won't deindexed domains throw a PR NA nearly right away?
      Some indexed domains show the same PR n/a these days.
      Signature

      For SEO news, discussions, tactics, and more.
      {{ DiscussionBoard.errors[9559736].message }}
  • Profile picture of the author SEOWizard417
    Yep, a PR check won't tell you if a domain was indexed. Scrapebox with private proxies is def the way to go.
    Signature
    {{ DiscussionBoard.errors[9560021].message }}
  • Profile picture of the author Rank Watch
    Scrapebox is a good idea. You can also try Netpeak software. Maybe that might help you.
    {{ DiscussionBoard.errors[9578195].message }}

Trending Topics