War Room

Go Back   WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum
Should we allow spiders and googlebot to access and crawl Feeds? Should we allow spiders and googlebot to access and crawl Feeds?
Register Blogs FAQ Social Groups CalendarHelp Desk Mark Forums Read

Featured Warrior Special Offer...
"Members Of The *War Room* Discover Secrets To Immediate Success!"
Reply
 
LinkBack Thread Tools
Old 08-31-2009, 08:23 AM   #1
Warrior Member
 
DIMSKK's Avatar
 
Join Date: Aug 2009
Posts: 25
Thanks: 0
Thanked 1 Time in 1 Post
Default Should we allow spiders and googlebot to access and crawl Feeds?
Hi

Should we allow spiders and googlebot to access and crawl Feeds or block them using robots.txt?

Any suggestions will be greatly appreciated.

Thanks in advance
momi
Free Content & Article Directory - Earn Money & Get Promoted - Articles, tips tutorials, how-tos, website & product reviews, guides and more.
DIMSKK is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

  WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum

Tags
access, crawl, feeds, googlebot, spiders

« Previous Thread | Top | Next Thread »
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


All times are GMT -6. The time now is 06:41 PM.