Fantastico, Wordpress, Robots.txt and Disallow

by blur
3 replies
I haven't noticed this before, but when trying to troubleshoot why my adsense ads were showing public service announcements on a new blog (even 24hours after set up) I found out that the basic fantastico installation of my wordpress was putting 'Disallow/' in the robots.txt file.

I have not noticed this before and this is my first fantastico install on this host. Is this common?
#disallow #fantastico #robotstxt #wordpress
  • Profile picture of the author tommygunn
    By default all my wordpress blogs are private. From WP Admin, Settings > Privacy. I'm not sure on the robots.txt, and if this is modified by wordpress, but it makes sense, I just never checked the robots.txt file prior to changing the setting.
    {{ DiscussionBoard.errors[1244747].message }}
    • Profile picture of the author netkid
      Blur,

      Just what Tommygunn is referring to, go to "settings" then "privacy," and uncheck the radio button that says block search engines and check the box above, "make blog visible to everyone and search engines." You will see a change from "no follow" in the code. It will start tracking with the engines. Then, give it one more day or so before things start happening with the search engine bots.

      By default now in Fantastico WP blog set ups, the search engine and public view is turned off. I think it is a good thing because when you first get things set up, you want to spend at least a day or two "tweaking" the blog site until you are ready to release to the public. I get hired to set up blogs for others and I need some prep time before I go "live."

      Hope that helps,

      Bruce
      {{ DiscussionBoard.errors[1244768].message }}
  • Profile picture of the author blur
    Yup, this makes sense! Thanks
    Signature

    {{ DiscussionBoard.errors[1299045].message }}

Trending Topics