Stupid, Stupid, Stupid! I Just Found Out Why My Sites Weren't Being Indexed by Google

by bettersocial

Posted: 15 years ago 20 replies

I had set the privacy settings in Wordpress to "Open to visitors, but closed to search engines".

There. That little thing probably cost me $1k/month.

By default, all my wordpress blogs used to be open to everyone, search engines included. Now they're all closed to search engines by default, which, of course, makes indexing them rather impossible. Some plugin must've triggered this change in the default settings.

(If you don't understand what I'm talking about, go to 'Settings -> Privacy' in your wordpress admin panel. You'll see that there are two options. On my blogs, option 2 (closed to search engines) had been selected by default).

So while I was tearing my hair out trying to figure out why my sites have got just one page indexed in Google after more than a month and hundreds of backlinks, I overlooked this single tiny aspect that made my sites inaccessible to all spiders.

I suggest that you guys check out your Wordpress blog's privacy settings too to see if they aren't blocking spiders.

#found #google #indexed #sites #stupid

Jason Johns 15 years ago

Hi there,

I don't believe it's a plugin that has made this change. I think it's a change in Wordpress to the default settings! It's frustrating and I think many of us have been caught out by this.

Thanks for reminding us all about it!

All the best

Jason
- Thanks
- 1 reply
Signature

Author, Seminar Leader and Coach
{{ DiscussionBoard.errors[1251188].message }}
- mmixon 15 years ago
  
  Learned something new and important today, (and it is still early) Thanks Sashas!
  
  Thanks
  
  Signature
  http://popgoesthebiz.com/ Websites, Mobile Marketing and Social Media Marketing for Business and Political Candidates.
  
  {{ DiscussionBoard.errors[1251230].message }}
Jacer 15 years ago

I have installed both the most current release and the previous release of wordpress recently. I am sure "open to all" was the default setting in both cases. Maybe you accidently changed it?
- Thanks
{{ DiscussionBoard.errors[1251241].message }}
Solidsnake Banned 15 years ago

I checked mine (just installed last week) and the first one is ticked.. no problem at all..

new blogs are hard to getting indexed..
- Thanks
{{ DiscussionBoard.errors[1251271].message }}
Fraggler 15 years ago

Default is definetly now 2nd option (clock search engines).
- Thanks
Signature

- Stop Wasting Time & Money on Traffic!
- You Can't Improve What You Don't Measure
- Why You Should Create Separate Desktop and Mobile Google Adwords Campaigns
Connect with me on LinkedIn
{{ DiscussionBoard.errors[1251298].message }}
turbohips 15 years ago

mine was fine and didn't have block search engines by default. The first option was selected
- Thanks
Signature

brit momaday leight
Larry Leight
{{ DiscussionBoard.errors[1251761].message }}
andybeveridge 15 years ago

This has happend to me only a couple of days ago. Its set that way as default.
I am pretty sure it didn't cost me $$$$ though.
- Thanks
Signature

Become a Digi Warrior and join us in the successful Dig Warrior IM Academy
Join us at www.digiwarrior.com
{{ DiscussionBoard.errors[1251784].message }}
Marhelper 15 years ago

Yeah, I made the same dumb mistake myself a while ago. Good thing you caught it now.
- Thanks
Signature

Senior Home Care San Diego
{{ DiscussionBoard.errors[1251815].message }}
bettersocial 15 years ago

I just did a check on all my blogs.

Blogs that were made before the middle of September have the first option enabled (open to search engines). Blogs made after that had the second option selected by default.

Heads up to everyone. All your marketing efforts will be of no use if the second option is selected.
- Thanks
Signature
--->>> Make $$$ Sharing Images on Twitter - With NO Website, NO Investment! <<<---
{{ DiscussionBoard.errors[1251895].message }}
mfleisch 15 years ago

Thanks sashas... been using mostly blogger and recently switched to WordPress. I didn't realize what the impact of not turning on this option would be!!!
- Thanks
{{ DiscussionBoard.errors[1251999].message }}
WareTime 15 years ago

I think they do it by default so you have time to mess around with permalinks and don't have the default posts indexed before you get around to looking at those things.

On an aside a friend of mine that runs WP has had great luck with no permalinks just the default it ships with. I'd like to think one day we'll see no more /really-long-and-boring-spammy-way-too-wordy-thing-here/ urls.
- Thanks
{{ DiscussionBoard.errors[1252006].message }}
Mike Johnson 15 years ago

Yep, I can confirm that a blog I installed several days ago using fantastico was blocking search engines by default.

I checked all of my other blogs (which I've recently updated to the current version) and they weren't blocking anything.
- Thanks
Signature
vexxt?
Making Sense of Retail Marketing and Sales
{{ DiscussionBoard.errors[1252476].message }}
nettech 15 years ago

Its quite an easy mistake to make. I used to put this setting on when I was testing my sites pre-launch. i did forget to put activate it once or twice but you do rmeember after a while. Thanks for the reminder...lol
- Thanks
Signature

Thanks
Zaheer
{{ DiscussionBoard.errors[1252630].message }}
Crafty Blogger 15 years ago

Yeah, I've noticed this problem recently too. It's really annoying, especially if the bots get to the blog before I remember to change the default settings on a new blog to allowing them to visit - it keeps the site from being indexed for an even longer period of time!
- Thanks
Signature
Passive Income Online Blog
{{ DiscussionBoard.errors[1252688].message }}

lanta99

15 years ago

Luckily I caught this thread before I launched my wordpress network. Anyways, do you know if this is the same setting on wordpress MU? If so, I'll be sure to watch out for that.

Thanks
1 reply

Signature

--Live SEO Challenge--

{{ DiscussionBoard.errors[1252813].message }}

bettersocial

15 years ago

Originally Posted by lanta99

Luckily I caught this thread before I launched my wordpress network. Anyways, do you know if this is the same setting on wordpress MU? If so, I'll be sure to watch out for that.

Haven't used WPMU so far, but there's no harm in checking.

Thanks

Signature

--->>> Make $$$ Sharing Images on Twitter - With NO Website, NO Investment! <<<---

{{ DiscussionBoard.errors[1252999].message }}

jasonmorgan 15 years ago

raises hand... guilty as well.

I've done that before in the past as well as forget about building a sitemap, changing wordpress permalinks and some other silly things.
- Thanks
Signature

I'm all about that bass.
{{ DiscussionBoard.errors[1253009].message }}
AJsVRE 15 years ago

Originally Posted by sashas

Some plugin must've triggered this change in the default settings.

There where a lot of people that had found out about this, and made posts on marketing forums and sent emails to their lists about this change. Sorry you hadn't seen it from one of those sources

It is NOT a plugin, it is now the DEFAULT SETTING if you install wordpress through fantastico. If you install wordpress manually (ftp'ing it to your server, manually setting up a database and going to the install config page - forgive me but I forget exactly what it's called, but if you've ever installed WP manually you know what I mean) then you don't have to worry, because when you do so, on the config page the option for that setting is right there.
- Thanks
{{ DiscussionBoard.errors[1253170].message }}
Sleaklight 15 years ago

Thanks for posting this tread. Google had been indexing my website but it was only indexing the URL's and not the descriptions. I read your post and went to check my settings and was in the same boat as you! I too feel stupid! Thanks for making this post, I appreciate it.
- Thanks
{{ DiscussionBoard.errors[1253236].message }}
bigcat1967 15 years ago

Thanks for posting this. Wondering if this applies to other Web 2.0 properties.
- Thanks
Signature

<a href="https://changeyourbudget.com/save-money-on-your-water-bill/">How to Lower Your Water Bill</a>
{{ DiscussionBoard.errors[1253334].message }}

Stupid, Stupid, Stupid! I Just Found Out Why My Sites Weren't Being Indexed by Google

Trending Topics

Newbie

How did you turn it all around?

A healthy fascination for Hollywood...

best high quality crypto traffic.

Any thoughts on golf's latest phenom...Scottie Scheffler??