Google May Add META NOINDEX Details To Google Webmaster Tools Report !!!!!!!

0 replies
  • SEO
  • |
A Google Webmaster Help thread has a suggestion from a webmaster. The suggestion is to add pages blocked in the diagnostic > crawl errors report for pages blocked by the META NOINDEX.

Currently, Google will display pages blocked for multiple of reasons, including restricted by robots.txt (Google was unable to crawl the URL due to a robots.txt restriction. This can happen for a number of reasons. For instance, your robots.txt file might prohibit the Googlebot entirely; it might prohibit access to the directory in which this URL is located; or it might prohibit access to the URL specifically. Often, this is not an error. You may have specifically set up a robots.txt file to prevent us from crawling this URL. If that is the case, there's no need to fix this; we will continue to respect robots.txt for this file.

If a URL redirects to a URL that is blocked by a robots.txt file, the first URL will be reported as being blocked by robots.txt (even if the URL is listed as Allowed in the robots.txt analysis tool).) but it won't show the pages blocked by the META NOINDEX tag.
#add #details #google #meta #noindex #report #tools #webmaster

Trending Topics