search engine blasting

Radix · 09-28-2009, 09:11 AM

good grief my server is getting hammered with search engine requests.

To the tune of 500 hits since midnight.

Anyone have any idea what that might be about?

I haven't done anything content wise that would explain this and my real organic traffic hasn't picked up at all.

KirkMcD · 09-28-2009, 10:06 AM

You may have been linked to be a high PR site or someone may be spoofing that they are an SE bot and is scraping your site.

If it's not Google, Yahoo or Bing, block them.

dburk · 09-28-2009, 10:15 AM

Hi Radix,

If you have AdSense on your site, and get a surge in visitors, you will see an equal surge in Googlebot-Mediabot which is the AdSense bot. If you are concerned you should spot check the IP addresses and verify they are owned by Google.

By the way, the site in your signature has a canonical issue.

Radix · 09-28-2009, 12:02 PM

I think I found the reason. I've never noticed this before and I've been using the twitter poster plugin for a while.

Every time the site makes a post to twitter, all the engines come clamoring to the link. Every time, all of the time.

Be a really good way to get your site indexed in a hurry I would think.

dburk · 09-28-2009, 01:44 PM

Quote:

Originally Posted by Radix

I think I found the reason. I've never noticed this before and I've been using the twitter poster plugin for a while.

Every time the site makes a post to twitter, all the engines come clamoring to the link. Every time, all of the time.

Be a really good way to get your site indexed in a hurry I would think.

Yeah, there is lots of spider food at Twitter and the SEs have their bots set to hyper-crawl speed on Twitter.

I beginning to think that 2009 will be known as the year of Twitter. I can't imagine how Twitter will dominate the internet if this trend continues.

Radix · 09-28-2009, 04:14 PM

Quote:

Originally Posted by dburk

Yeah, there is lots of spider food at Twitter and the SEs have their bots set to hyper-crawl speed on Twitter.

I beginning to think that 2009 will be known as the year of Twitter. I can't imagine how Twitter will dominate the internet if this trend continues.

This is unreal.

I'm already rethinking about ways to incorporate Twitter into my next 3 projects.

09-28-2009, 09:11 AM	#1
Radix Howdy War Room Member Join Date: Apr 2009 Location: Midwest Posts: 292 Thanks: 21 Thanked 56 Times in 39 Posts	search engine blasting good grief my server is getting hammered with search engine requests. To the tune of 500 hits since midnight. Anyone have any idea what that might be about? I haven't done anything content wise that would explain this and my real organic traffic hasn't picked up at all.
	Outside of a dog, a book is a man's best friend. Inside of a dog it's too dark to read. -Groucho Marx

09-28-2009, 10:06 AM	#2
KirkMcD Senior Warrior Member War Room Member Join Date: Apr 2006 Location: , , USA. Posts: 2,433 Thanks: 40 Thanked 155 Times in 148 Posts	Re: search engine blasting You may have been linked to be a high PR site or someone may be spoofing that they are an SE bot and is scraping your site. If it's not Google, Yahoo or Bing, block them.

09-28-2009, 10:15 AM	#3
dburk Senior Warrior Member Join Date: Nov 2005 Location: Tampa, Florida Posts: 4,473 Thanks: 135 Thanked 640 Times in 552 Posts Contact Info	Re: search engine blasting Hi Radix, If you have AdSense on your site, and get a surge in visitors, you will see an equal surge in Googlebot-Mediabot which is the AdSense bot. If you are concerned you should spot check the IP addresses and verify they are owned by Google. By the way, the site in your signature has a canonical issue.
	Don Burk * Get Results - Outsource Your PPC Management * Get a Keyword Domain Name - www.SeriousNames.com

09-28-2009, 12:02 PM	#4
Radix Howdy War Room Member Join Date: Apr 2009 Location: Midwest Posts: 292 Thanks: 21 Thanked 56 Times in 39 Posts	Re: search engine blasting I think I found the reason. I've never noticed this before and I've been using the twitter poster plugin for a while. Every time the site makes a post to twitter, all the engines come clamoring to the link. Every time, all of the time. Be a really good way to get your site indexed in a hurry I would think.
	Outside of a dog, a book is a man's best friend. Inside of a dog it's too dark to read. -Groucho Marx