search engine blasting

by Radix

Posted: 15 years ago 5 replies

good grief my server is getting hammered with search engine requests.

To the tune of 500 hits since midnight.

Anyone have any idea what that might be about?

I haven't done anything content wise that would explain this and my real organic traffic hasn't picked up at all.

#blasting #engine #search

KirkMcD

15 years ago

You may have been linked to be a high PR site or someone may be spoofing that they are an SE bot and is scraping your site.

If it's not Google, Yahoo or Bing, block them.

Thanks
1 reply

{{ DiscussionBoard.errors[1226504].message }}

dburk

15 years ago

Hi Radix,

If you have AdSense on your site, and get a surge in visitors, you will see an equal surge in Googlebot-Mediabot which is the AdSense bot. If you are concerned you should spot check the IP addresses and verify they are owned by Google.

By the way, the site in your signature has a canonical issue.

Thanks
1 reply

Signature

* Get Results - Outsource Your PPC Management |
* Don Burk Advertising & Marketing - www.donburk.com

{{ DiscussionBoard.errors[1226544].message }}

Radix

15 years ago

I think I found the reason. I've never noticed this before and I've been using the twitter poster plugin for a while.

Every time the site makes a post to twitter, all the engines come clamoring to the link. Every time, all of the time.

Be a really good way to get your site indexed in a hurry I would think.

Thanks
1 reply

Signature

Outside of a dog, a book is a man's best friend. Inside of a dog it's too dark to read.
-Groucho Marx

{{ DiscussionBoard.errors[1226844].message }}

dburk

15 years ago

Originally Posted by Radix

Yeah, there is lots of spider food at Twitter and the SEs have their bots set to hyper-crawl speed on Twitter.

I beginning to think that 2009 will be known as the year of Twitter. I can't imagine how Twitter will dominate the internet if this trend continues.