Is It Necessary for Google To Crawl Admin Pages?

by Lian
4 replies
  • SEO
  • |
I was working to improve the load up time of my website. It appears some of my admin pages were the culprit in slowing down the time they take to load in a browser.
E.g.

example.com/wp-admin/edit-comments.php

example.com/wp-admin/options-general.php

example.com/wp-admin/theme-editor.php

Is it necessary for Google to crawl these pages? These are admin pages and I suspect I've screwed up somewhere in site building.


Will blocking these pages from being crawl improve the load time and will it effect the site's SE Optimization?

Thanks for the help.

Lian
#admin #crawl #google #pages
  • Profile picture of the author TimScott
    I'd block them from the spiders, I mean I really don't see a reason why they need to be indexed. Use the Robots Meta plugin, and you can easily block all the admin pages.
    {{ DiscussionBoard.errors[1489677].message }}
  • Make sure that you block all the pages from admin panel to be indexed in G or even in any other search engines. make use of robot.txt file to stop search engines to crawl the pages.

    Also you need to remove those admin pages that are already been indexed by G. Find more information about it by Googling.
    {{ DiscussionBoard.errors[1491050].message }}
  • {{ DiscussionBoard.errors[1491100].message }}
    • Profile picture of the author Lian
      Thank you all for your assistance.

      @TimScott,

      The Robots Meta Plugin makes the task really easy. Thank you.

      Lian
      {{ DiscussionBoard.errors[1491299].message }}

Trending Topics