Warrior Forum - The #1 Digital Marketing Forum & Marketplace

Warrior Forum - The #1 Digital Marketing Forum & Marketplace (https://www.warriorforum.com/)
-   Plug-In Profit Site Support Forum (https://www.warriorforum.com/plug-profit-site-support-forum/)
-   -   How important is robots.txt for SEO (https://www.warriorforum.com/plug-profit-site-support-forum/261304-how-important-robots-txt-seo.html)

diff122 16th September 2010 03:17 AM

How important is robots.txt for SEO
 
Hi Warriors,

Just need some suggestions regarding the importance of robots.txt for good SEO. How important is that?

The reason why I am asking is I have been ranking on page 1 and 2 of google for certain long tail keywords and my alexa ranking has improved quite a lot since my website launch, though I do not have any robots.txt for my site.

Hence, I am just wondering how exactly is that file important.
Waiting for some feedback.

Thanks,
Aviroop

Allen Lundy 16th September 2010 11:32 AM

Re: How important is robots.txt for SEO
 
Good Question!

The robots.txt file is what you would use to tell the search engines what files to disallow - NOT to index...

Here is a good article explaining what a robots.txt file is and on how to set up your own robots.txt file for your websites.

Robots.txt: All you need to know



Allen Lundy

cooljazz 16th September 2010 06:31 PM

Re: How important is robots.txt for SEO
 
Article explained it all.

diff122 16th September 2010 11:33 PM

Re: How important is robots.txt for SEO
 
Thanks a lot Allen,

That was a very helpful article.


Regards,
Aviroop


All times are GMT -6. The time now is 10:36 PM.