8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

URL Inspection question

by jacktravers
7 replies

URL Inspection question

  • I type in a url from one of my site pages into Google Inspection Tool. Says it can't be indexed because of robots file blocking it.
  • Did a "live test" and says the URL is available on Google.
  • "Discovery" not checked in live tests.
  • I sent another index request which was sent successfully.

Does anyone know is this normal to see the first point but then indexing becomes available?
#inspection #question #url
Avatar of Unregistered
  • Profile picture of the author JackReacherx
    By reading your post the main issue you are facing that the URL that you are testing it is blocked by robots.txt file that is why your page is not being index if you are using WordPress Plugins like rank math or Yoast then open the plugin settings and locate robots.txt and now find your URL in the File that is followed by Disallow remove that URL from the file or simply remove "Disallow" and add Allow then your issue would be resolved if not reach out to me
    {{ DiscussionBoard.errors[11788669].message }}
    • Profile picture of the author jacktravers
      [DELETED]
      {{ DiscussionBoard.errors[11788702].message }}
    • Profile picture of the author jacktravers
      Originally Posted by JackReacherx View Post

      By reading your post the main issue you are facing that the URL that you are testing it is blocked by robots.txt file that is why your page is not being index if you are using WordPress Plugins like rank math or Yoast then open the plugin settings and locate robots.txt and now find your URL in the File that is followed by Disallow remove that URL from the file or simply remove "Disallow" and add Allow then your issue would be resolved if not reach out to me
      when I do the "live test" on search console says URL is available on Google but I believe not indexed.
      But when I click put the url into the top box in search console "inspect any url" says its not indexed?
      {{ DiscussionBoard.errors[11788704].message }}
    • Profile picture of the author jacktravers
      Originally Posted by JackReacherx View Post

      By reading your post the main issue you are facing that the URL that you are testing it is blocked by robots.txt file that is why your page is not being index if you are using WordPress Plugins like rank math or Yoast then open the plugin settings and locate robots.txt and now find your URL in the File that is followed by Disallow remove that URL from the file or simply remove "Disallow" and add Allow then your issue would be resolved if not reach out to me



      Hi Jack Reacher. I have found the robots file in my yoast seo tools section.
      From here I am not sure where to find the indiv pages with the coding so I can change the robots file to allow instead of disallow.


      When I enter them into SEARCH console, it says they are blocked. I wish to update the pages with new info, pictures etc.


      Cheers!
      {{ DiscussionBoard.errors[11789245].message }}
  • Profile picture of the author savidge4
    Originally Posted by jacktravers View Post

    [LIST][*]I type in a url from one of my site pages into Google Inspection Tool. Says it can't be indexed because of robots file blocking it.
    Forget "Live Test" and forget "Inspect any URL" The inspection tool you used stated clearly "it can't be indexed because of robots file blocking it." Have you looked at you Robot.txt file? does it say "Disallow"?

    Stop with the tools, this is when you need to put your programming hat on and get into the file to see if there is an issue. You can open the file in Microsoft Wordpad... you can find more than enough information on Google to see what a correct functioning Robots.txt file looks like. On a scale of 1 to 10 in the programming world this task is a 1 for sure.
    Signature
    Success is an ACT not an idea
    {{ DiscussionBoard.errors[11788736].message }}
  • Profile picture of the author jacktravers
    Hey guys I have a question.


    On eof my pages was not indexed esrlier today but was "available on google." I requested the indexing on Search console multiple times today and now is indexed.



    Does anyone know how this happened?


    I had linked to one of my articles and linked out to another article.


    Let me know!
    {{ DiscussionBoard.errors[11788742].message }}
    • Profile picture of the author savidge4
      Originally Posted by jacktravers View Post

      On eof my pages was not indexed esrlier today but was "available on google." I requested the indexing on Search console multiple times today and now is indexed.
      When I turned on the water it was cold... i then moved the handle to HOT... can you believe the water is now hot? how did that happen?

      YOU answered your own question, it happened in 1 of 2 ways 1) because you requested the page to be indexed, the spider indexed it, or 2) because you linked to the content from another piece of content the spider followed the link and indexed the page. regardless of HOW, the fact is it IS.. and congratulations on that.
      Signature
      Success is an ACT not an idea
      {{ DiscussionBoard.errors[11788750].message }}
      • Profile picture of the author jacktravers
        Ok thats great thank you! So I should do this when looking to index updated pages? Request index.
        {{ DiscussionBoard.errors[11788802].message }}
Avatar of Unregistered

Trending Topics