Htaccess where did this come from?

4 replies
I found this in the top level directory of my wordpress blog and
1. I don't know where it came from
2. I'm not sure what it is blocking (I think it blocks the legitimate search engines from the admin and login pages)

# BEGIN BLOG HOSTING PART
# Deny search bots
<IfModule mod_rewrite.c>
RewriteCond %{HTTP_USER_AGENT} (google|gsa-crawler|msn|yahoo|Y!|SpiderMan|crawler|Scooter|Alt aVista|Slurp) [NC]
RewriteCond %{REQUEST_URI} ^/(wp-admin/|wp-content/|wp-login.php)
RewriteRule .* - [F]
</IfModule>

Anybody know for sure?
#htaccess
  • Profile picture of the author brandasaur
    don't touch that thing if you don't know what you're doing. all hosting have that file i guess. You can edit it for some reasons but shouldn't be touched. It is used to edit urls, hide file extensions of the page and a lot more.
    {{ DiscussionBoard.errors[2947686].message }}
  • Profile picture of the author KirkMcD
    It's blocking SEs from seeing these files and directories:

    wp-admin, wp-content, wp-login.php
    {{ DiscussionBoard.errors[2948140].message }}
  • Profile picture of the author kkoechel
    Originally Posted by RobinInTexas View Post

    I found this in the top level directory of my wordpress blog and
    1. I don't know where it came from
    2. I'm not sure what it is blocking (I think it blocks the legitimate search engines from the admin and login pages)

    # BEGIN BLOG HOSTING PART
    # Deny search bots
    <IfModule mod_rewrite.c>
    RewriteCond %{HTTP_USER_AGENT} (google|gsa-crawler|msn|yahoo|Y!|SpiderMan|crawler|Scooter|Alt aVista|Slurp) [NC]
    RewriteCond %{REQUEST_URI} ^/(wp-admin/|wp-content/|wp-login.php)
    RewriteRule .* - [F]
    </IfModule>

    Anybody know for sure?
    it's code to stop known webcrawlers.

    edit: nvm
    {{ DiscussionBoard.errors[2949604].message }}
  • Profile picture of the author phpbbxpert
    I'm guessing that you are running a security plug-in or it was included from a custom WP installer provided from your host.

    Those are the pages it's blocking from being crawled, which you don't want crawled anyway, so it's all good.
    {{ DiscussionBoard.errors[2950364].message }}

Trending Topics