Marketplace
Warrior Special Offers

Exclusive products and services available only at Warrior Forum

Get great deals on Internet Marketing Products, Services, Trainings and other Offers at the world's largest Internet marketing marketplace

9
Search
Search The Warrior Forum
Register Advertise with usHelp Desk Today's Posts Search

Advertise with Us
Showing results 1 to 2 of 2
Search took 0.48 seconds. Search: Posts Made By: loginname
Forum: Search Engine Optimization 26th March 2010, 03:33 AM
Replies: 1
Views: 767
Posted By loginname
Re: Problem: URL restricted by robots.txt

My robots.txt is like this (a shorten version):
User-agent: *
Sitemap: http://www.mydomain.com/sitemap.xml
Allow: /
Disallow: /folder1/
Disallow: /folder2/
Disallow: /Error.htm
Forum: Search Engine Optimization 26th March 2010, 03:24 AM
Replies: 1
Views: 767
Posted By loginname
Problem: URL restricted by robots.txt

Hi

In google webmaster tools I've found 3 crawl errors like "URL restricted by robots.txt".

This is a mystery to me. I suspect only 2 of the pages are restricted by robots.txt. One of the...
Showing results 1 to 2 of 2

 
Forum Jump
Advertise with Us


All times are GMT -6. The time now is 12:01 AM.

Terms of Use - Privacy Policy - DMCA Notice