7 {{ upvoteCount | shortNum }}
7 {{ upvoteCount | shortNum }}

Is this website blocking search engine indexing? how to tell?

by source206
6 replies
  • SEO
    • |
Hi guys,

I am trying to get this article I posted on a third party website - but none of the articles posted are getting indexed.

Is there a way to check third party websites to see if they are currently blocking google and search engine bots? or is this something we can't tell?
#blocking #engine #indexing #search #website
Avatar of Unregistered
  • Profile picture of the author dave_hermansen
    You could try entering their domain named followed by /robots.txt
    Signature
    StoreCoach.com - FREE TRAINING - Learn How to Build Your Own eCommerce Website
    My PROVEN ecommerce process, as seen on: Fox Business News, the NY Times & Flippa
    {{ DiscussionBoard.errors[11311006].message }}
  • Profile picture of the author MikeFriedman
    Originally Posted by source206 View Post

    Hi guys,

    I am trying to get this article I posted on a third party website - but none of the articles posted are getting indexed.

    Is there a way to check third party websites to see if they are currently blocking google and search engine bots? or is this something we can't tell?
    Originally Posted by dave_hermansen View Post

    You could try entering their domain named followed by /robots.txt
    In addition to that, you can look at the source code of the page and see if they added a noindex tag to it.
    Signature
    Get the TIPS and STRATEGIES I use to HELP businesses GROW through SEO.
    Delivered to you each week!

    >>> Sign Up Now <<<
    {{ DiscussionBoard.errors[11311019].message }}
    • Profile picture of the author source206
      But for someone who doesnt know coding html etc, is there a way, or what does the noindex tag look like?
      Signature

      None

      {{ DiscussionBoard.errors[11311044].message }}
      • Profile picture of the author dave_hermansen
        If all search engines were blocked, the robots.txt file would have this, usually at the very top:

        User-agent: *
        Disallow: /

        Also, they could be blocking robots in the <Head> section of the website. Right click on a page and then choose "View Source". Then hold down CONTROL and F on your keyboard (COMMAND and F on a Mac) to open up a search box. Search for "<head>" (without the quotes) and then look at the code following that and before the closing </head> tag. What you are looking for is a line of code that says:

        <meta name="robots" content="noindex">

        Or, if they are only blocking Google for some reason, it might say:

        <meta name="googlebot" content="noindex">
        Signature
        StoreCoach.com - FREE TRAINING - Learn How to Build Your Own eCommerce Website
        My PROVEN ecommerce process, as seen on: Fox Business News, the NY Times & Flippa
        {{ DiscussionBoard.errors[11311135].message }}
  • Profile picture of the author BryrDe
    I agree with Dave. Try checking their robots.txt. Also, you can try this search string: keyword or some words of the article you mentioned + site:domain.com to see if Google can search it on their site.
    {{ DiscussionBoard.errors[11311209].message }}
  • Profile picture of the author ernestrategos
    If you are using a Wordpress website you can check if "Discourage search engines from indexing this site" setting is doing something to rankings.
    {{ DiscussionBoard.errors[11312569].message }}
Avatar of Unregistered

Trending Topics