i got an error with google bots crawl
I have an error that i just can't get ride of after trying alot of things it says that my domain is restricted but i rank my other pages on google and i have checked my robots.txt and it allows the robots to fetch my website after some research i found out that maybe the .htaccess could be the problem this is what i have there.
# -FrontPage-
IndexIgnore .htaccess */.??* *~ *# */HEADER* */README* */_vti*
<Limit GET POST>
order deny,allow
deny from all
allow from all
</Limit>
<Limit PUT DELETE>
order deny,allow
deny from all
</Limit>
AuthName **********.com
AuthUserFile /home/*****/public_html/_vti_pvt/service.pwd
AuthGroupFile /home/*****/public_html/_vti_pvt/service.grp
# BEGIN WordPress
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>
# END WordPress
What is this indexignore .htaccess and all those deny allow can i remove all this.
Ihad also another question one thing that i am not sure of is i have pages like my contact privacy and disclosure policy ranking for my keyword but not just the domain it self should i block them in my robots.txt file or just leave them.
Thanks any help would be greatly appreciated.
-
Christian Little -
Thanks - 1 reply
SignaturecPanel Shared and Reseller Web Hosting - 30 Day Free Trial Exclusive for Warriors!{{ DiscussionBoard.errors[3399730].message }}-
vbskss -
Thanks
{{ DiscussionBoard.errors[3399788].message }} -
-
-
Christian Little -
Thanks
SignaturecPanel Shared and Reseller Web Hosting - 30 Day Free Trial Exclusive for Warriors!{{ DiscussionBoard.errors[3399835].message }} -