How do I allow spiders to crawl this URL?

ChrisGrayson · 13th May 2010, 11:20 AM

I was hoping someone could advise me about this?

I am using Wordpress for my blog and I have just noticed that this URL http://www.the-biz-to-be-in.com/latest-blog/ does not allow robot spiders to crawl it. How can I allow them? Any advice would be greatly appreciated!

Regards,

Chris

Trent Brownrigg · 13th May 2010, 02:14 PM

It looks like you might have your all-in-one-seo-pack set up that way. Go into the settings and makes sure you have it set up correctly. Also, in your "privacy" settings for the blog make sure you have the option ticked to allow search engines to index it.

l23bc · 13th May 2010, 03:01 PM

Intresting infomation can i ask what does "use noindex for archives" mean on wordpress all in one seo pack, does that have to be enabed. Im trying to work out in the popularity post widget why it says im getting no search engine traffic on my site yet im on page one for google and yahoo for keywords.

13th May 2010, 11:20 AM	#1
ChrisGrayson Warrior Member Join Date: 2009 Location: Leiden, Holland Posts: 16 Thanks: 11 Thanked 0 Times in 0 Posts	How do I allow spiders to crawl this URL? Share on: I was hoping someone could advise me about this? I am using Wordpress for my blog and I have just noticed that this URL http://www.the-biz-to-be-in.com/latest-blog/ does not allow robot spiders to crawl it. How can I allow them? Any advice would be greatly appreciated! Regards, Chris
	YourTopAffiliatePrograms.com Top affiliate programs, tips and advice...

13th May 2010, 02:14 PM	#2
Trent Brownrigg Advanced Warrior War Room Member Join Date: 2004 Location: Iowa, USA Posts: 969 Thanks: 99 Thanked 183 Times in 117 Posts	Re: How do I allow spiders to crawl this URL? Share on: It looks like you might have your all-in-one-seo-pack set up that way. Go into the settings and makes sure you have it set up correctly. Also, in your "privacy" settings for the blog make sure you have the option ticked to allow search engines to index it.
	You can find internet marketing strategies, SEO consulting, and tons of business advice at BAM!

13th May 2010, 03:01 PM	#3
l23bc andrew hams @ka l23bc War Room Member Join Date: 2008 Location: UK Posts: 1,555 Thanks: 102 Thanked 119 Times in 106 Posts Blog Entries: 10	Re: How do I allow spiders to crawl this URL? Share on: Intresting infomation can i ask what does "use noindex for archives" mean on wordpress all in one seo pack, does that have to be enabed. Im trying to work out in the popularity post widget why it says im getting no search engine traffic on my site yet im on page one for google and yahoo for keywords.
	No Link here or Nothing to Promote Just a Old Happy Warrior User reading Topics