7 {{ upvoteCount | shortNum }}
7 {{ upvoteCount | shortNum }}

How to change robots.txt

by xvisionxx
6 replies
  • WEB DESIGN
    • |
I didnt really know where to post it,but I need help changing the robots.txt of my site,because it disallows wp-admin and wp-includes,which affects googlebot.

or maybe if robots.txt blocks only wp-admin and wp-includes,it wont hurt me?

thanks.
#change #robotstxt
  • Profile picture of the author WordPressurize
    Originally Posted by xvisionxx View Post

    I didnt really know where to post it,but I need help changing the robots.txt of my site,because it disallows wp-admin and wp-includes,which affects googlebot.

    or maybe if robots.txt blocks only wp-admin and wp-includes,it wont hurt me?

    thanks.
    @xvisionxx You do not want search engines indexing anything in wp-admin or wp-includes. These are system directories that control the administration functions and core functions of WordPress.
    Signature

    "The Dominance characteristic values competency, results, and action. The Influence characteristic values action, enthusiasm, and relationships. The Steadiness characteristic values relationships, sincerity, and dependability. The Conscientiousness characteristic values dependability, quality, and competency... it is necessary to give them the thing they value most." - from Convert, by Ben Hunt

    {{ DiscussionBoard.errors[5247090].message }}
  • Profile picture of the author itsnaveenreddy
    Try this plugin and it will be easy for you to edit the robots.txt from the admin panel
    WordPress › PC Robots.txt « WordPress Plugins
    Hope helps!
    Signature
    >>>Niche site for sale with 560$ adsense earnings since April, 2012. Contact me to grab this earning site<<<
    {{ DiscussionBoard.errors[5247098].message }}
  • Profile picture of the author alexschmidt
    Originally Posted by xvisionxx View Post

    I didnt really know where to post it,but I need help changing the robots.txt of my site,because it disallows wp-admin and wp-includes,which affects googlebot.

    or maybe if robots.txt blocks only wp-admin and wp-includes,it wont hurt me?

    thanks.
    i don't think it will heart you but i will recommend you to keep the googlebot away from wp-admin & wp-includes because these two directories are related to the administration section which i will never want Google to index.

    on the other hand it doesn't affect the content of the website being indexed by Google.

    in short the robots.txt that you have is ok.
    {{ DiscussionBoard.errors[5249587].message }}
  • Profile picture of the author RobKonrad
    In fact - depending on the page, hiding as much as possible that shows the bots that it's wordpress can be a very GOOD thing!

    Especially when it comes ot autoblogs, hiding wordpress lowers the risk of them being deindexed. Tested this a couple of times.

    Cheers,
    Rob
    Signature
    ================================================== ===
    This blog is awesome: http://www.robkonrad.com/blog. Read it.
    ================================================== ===
    {{ DiscussionBoard.errors[5249729].message }}
  • Profile picture of the author naqikhan
    Only front pages of the site are designed and optimized for search engines and there is no use of giving access to search engine to crawl your website back end files or admin console it will give more chances to hackers to inject malicious content.
    {{ DiscussionBoard.errors[5253648].message }}
  • Profile picture of the author semutdesign
    If that robots.txt come along with WordPress installation, then nothing need to be worried.
    {{ DiscussionBoard.errors[5255407].message }}

Trending Topics