Robots.txt to block search engines?
- SEO |
There are Soooo Manyyyyy of them.
So I thought that I could use the disable or disallow in the robots.txt file for the friendly engines and then create a blackhole for the bots/crawlers/spiders that don't want to give respect to the robots file.
Does anyone have a bot/crawler/spider list of the majors and are not dead?
Another thing...has anyone included disallowing google.fr, google.com.es and had any adverse reactions to google.com indexing and ranking?
Google bots (not the one specific to the US, CA and UK) are indexing my images in foreign countries and now my bounce rate is over 85 percent. I Swear Sometimes I think google is just a retard and I can't figure out why ppl play up to them.
Tired Of RISKY SEO Hosting? This Option Is SAFE
WordPress Hosting
SEO Hero