search engine blasting

Radix · 09-28-2009, 09:11 AM

good grief my server is getting hammered with search engine requests.

To the tune of 500 hits since midnight.

Anyone have any idea what that might be about?

I haven't done anything content wise that would explain this and my real organic traffic hasn't picked up at all.

KirkMcD · 09-28-2009, 10:06 AM

You may have been linked to be a high PR site or someone may be spoofing that they are an SE bot and is scraping your site.

If it's not Google, Yahoo or Bing, block them.

dburk · 09-28-2009, 10:15 AM

Hi Radix,

If you have AdSense on your site, and get a surge in visitors, you will see an equal surge in Googlebot-Mediabot which is the AdSense bot. If you are concerned you should spot check the IP addresses and verify they are owned by Google.

By the way, the site in your signature has a canonical issue.

Radix · 09-28-2009, 12:02 PM

I think I found the reason. I've never noticed this before and I've been using the twitter poster plugin for a while.

Every time the site makes a post to twitter, all the engines come clamoring to the link. Every time, all of the time.

Be a really good way to get your site indexed in a hurry I would think.

dburk · 09-28-2009, 01:44 PM

Quote:

Originally Posted by Radix

I think I found the reason. I've never noticed this before and I've been using the twitter poster plugin for a while.

Every time the site makes a post to twitter, all the engines come clamoring to the link. Every time, all of the time.

Be a really good way to get your site indexed in a hurry I would think.

Yeah, there is lots of spider food at Twitter and the SEs have their bots set to hyper-crawl speed on Twitter.

I beginning to think that 2009 will be known as the year of Twitter. I can't imagine how Twitter will dominate the internet if this trend continues.

Radix · 09-28-2009, 04:14 PM

Quote:

Originally Posted by dburk

Yeah, there is lots of spider food at Twitter and the SEs have their bots set to hyper-crawl speed on Twitter.

I beginning to think that 2009 will be known as the year of Twitter. I can't imagine how Twitter will dominate the internet if this trend continues.

This is unreal.

I'm already rethinking about ways to incorporate Twitter into my next 3 projects.

09-28-2009, 09:11 AM	#1
Radix Court Jester War Room Member Join Date: Apr 2009 Location: Midwest Posts: 241 Thanks: 18 Thanked 15 Times in 11 Posts	search engine blasting good grief my server is getting hammered with search engine requests. To the tune of 500 hits since midnight. Anyone have any idea what that might be about? I haven't done anything content wise that would explain this and my real organic traffic hasn't picked up at all.
	Suede Slouch Boots

09-28-2009, 10:06 AM	#2
KirkMcD Senior Warrior Member War Room Member Join Date: Apr 2006 Location: , , USA. Posts: 1,711 Thanks: 17 Thanked 41 Times in 40 Posts	Re: search engine blasting You may have been linked to be a high PR site or someone may be spoofing that they are an SE bot and is scraping your site. If it's not Google, Yahoo or Bing, block them.

09-28-2009, 10:15 AM	#3
dburk Senior Warrior Member Join Date: Nov 2005 Location: Tampa, Florida Posts: 2,238 Thanks: 20 Thanked 184 Times in 167 Posts	Re: search engine blasting Hi Radix, If you have AdSense on your site, and get a surge in visitors, you will see an equal surge in Googlebot-Mediabot which is the AdSense bot. If you are concerned you should spot check the IP addresses and verify they are owned by Google. By the way, the site in your signature has a canonical issue.
	Don Burk * Get Results - Outsource Your PPC Management * Get a Keyword Domain Name - www.SeriousNames.com

09-28-2009, 12:02 PM	#4
Radix Court Jester War Room Member Join Date: Apr 2009 Location: Midwest Posts: 241 Thanks: 18 Thanked 15 Times in 11 Posts	Re: search engine blasting I think I found the reason. I've never noticed this before and I've been using the twitter poster plugin for a while. Every time the site makes a post to twitter, all the engines come clamoring to the link. Every time, all of the time. Be a really good way to get your site indexed in a hurry I would think.
	Suede Slouch Boots