Question

DaWarrior · 03-19-2010, 10:11 AM

Is it possible for web crawlers like MSNBOT to hit your site a LOT everyday and looks like unique visitors???

InternetSuccess001 · 03-19-2010, 10:13 AM

Yes. GoogleBot, MSN, etc, etc, all use various ip addresses to 'check' your site. They also have 'hidden' bots sometimes to determine if you are trying to do any kind of SEO cloaking, etc to game the search engines.

With most log software, you can exclude certain IP addresses so you get a much more 'realistic' idea of what your real traffic is.

DaWarrior · 03-19-2010, 10:20 AM

But why does MSNBOT crawl a site so much?

DaWarrior · 03-19-2010, 10:22 AM

Another questions could bots be considered as ORGANIC traffic?

paulgl · 03-19-2010, 01:40 PM

That's funny. Asking why bots are visiting so much.

As if that were bad. You want it and need to encourage
it. You get it by being a trusted, mass appeal, changing
content, etc. In fact, this post will be crawled in two
shakes of a lambs tail because warrorforum gets the
crawling love.

Organic traffic? I am rolling on that one. I guess it's
the most organic traffic one could get! So to speak.

It may look like a unique visitor. Check you logs and you
can see who last visited your site.

For most of us, you don't really want the bots not crawling,
although many don't update often enough to actually
"warrant" one. But you want want the bots. Just not
spam bots.

Paul

DaWarrior · 03-19-2010, 03:01 PM

Thanks, these bots are coming in crazy fast all from msnbot mostley, botgoogle, and yahoo slurps

SO this is a GOOD THING? When I start adding fresh content???

Quote:

Originally Posted by paulgl

That's funny. Asking why bots are visiting so much.

As if that were bad. You want it and need to encourage
it. You get it by being a trusted, mass appeal, changing
content, etc. In fact, this post will be crawled in two
shakes of a lambs tail because warrorforum gets the
crawling love.

Organic traffic? I am rolling on that one. I guess it's
the most organic traffic one could get! So to speak.

It may look like a unique visitor. Check you logs and you
can see who last visited your site.

For most of us, you don't really want the bots not crawling,
although many don't update often enough to actually
"warrant" one. But you want want the bots. Just not
spam bots.

Paul

paulgl · 03-19-2010, 04:14 PM

Well, if they don't visit, you don't get indexed or updated.

Look for the most valuable one, googlebot.

Bots will visit whenever they please. But yes, you
want them to visit.

Don't be afraid of them, if that's part of your concern.

Paul

DaWarrior · 03-19-2010, 04:17 PM

That's good but my concern is the person I purchased a site stated 50 unique organic visitors. And so far they are ONLY from google/msn/yahoo bots
Should I ask my money back???

03-19-2010, 10:11 AM	#1
DaWarrior HyperActive Warrior War Room Member Join Date: May 2009 Location: US Posts: 367 Thanks: 1 Thanked 6 Times in 6 Posts	Question - BOTS Is it possible for web crawlers like MSNBOT to hit your site a LOT everyday and looks like unique visitors???

03-19-2010, 10:13 AM	#2
InternetSuccess001 AffiliateInABox.com War Room Member Join Date: Mar 2010 Posts: 1,200 Thanks: 139 Thanked 290 Times in 114 Posts	Re: Question - BOTS Yes. GoogleBot, MSN, etc, etc, all use various ip addresses to 'check' your site. They also have 'hidden' bots sometimes to determine if you are trying to do any kind of SEO cloaking, etc to game the search engines. With most log software, you can exclude certain IP addresses so you get a much more 'realistic' idea of what your real traffic is.
	Pick a product. Pick ANY product! -> 1 \| 2 \| 3 \| 4 \| 5 \| 6 \| 7 \| 8 \| 9

03-19-2010, 10:20 AM	#3
DaWarrior HyperActive Warrior War Room Member Join Date: May 2009 Location: US Posts: 367 Thanks: 1 Thanked 6 Times in 6 Posts	Re: Question - BOTS But why does MSNBOT crawl a site so much?

03-19-2010, 10:22 AM	#4
DaWarrior HyperActive Warrior War Room Member Join Date: May 2009 Location: US Posts: 367 Thanks: 1 Thanked 6 Times in 6 Posts	Re: Question - BOTS Another questions could bots be considered as ORGANIC traffic?

03-19-2010, 01:40 PM	#5
paulgl Plundering the Web War Room Member Join Date: Feb 2007 Location: , , . Posts: 4,849 Thanks: 804 Thanked 1,199 Times in 886 Posts	Re: Question - BOTS That's funny. Asking why bots are visiting so much. As if that were bad. You want it and need to encourage it. You get it by being a trusted, mass appeal, changing content, etc. In fact, this post will be crawled in two shakes of a lambs tail because warrorforum gets the crawling love. Organic traffic? I am rolling on that one. I guess it's the most organic traffic one could get! So to speak. It may look like a unique visitor. Check you logs and you can see who last visited your site. For most of us, you don't really want the bots not crawling, although many don't update often enough to actually "warrant" one. But you want want the bots. Just not spam bots. Paul
	How to Make Money off Facebook: Login to your account. Deactivate your account. Get your butt to work.

03-19-2010, 04:14 PM	#7
paulgl Plundering the Web War Room Member Join Date: Feb 2007 Location: , , . Posts: 4,849 Thanks: 804 Thanked 1,199 Times in 886 Posts	Re: Question - BOTS Well, if they don't visit, you don't get indexed or updated. Look for the most valuable one, googlebot. Bots will visit whenever they please. But yes, you want them to visit. Don't be afraid of them, if that's part of your concern. Paul
	How to Make Money off Facebook: Login to your account. Deactivate your account. Get your butt to work.

03-19-2010, 04:17 PM	#8
DaWarrior HyperActive Warrior War Room Member Join Date: May 2009 Location: US Posts: 367 Thanks: 1 Thanked 6 Times in 6 Posts	Re: Question - BOTS That's good but my concern is the person I purchased a site stated 50 unique organic visitors. And so far they are ONLY from google/msn/yahoo bots Should I ask my money back???