6 {{ upvoteCount | shortNum }}
6 {{ upvoteCount | shortNum }}

STOP Google, Yahoo and Bing Indexing question

by nelsonbiglar
4 replies
  • WEB DESIGN
    • |
I want to get some info on setting up a webite (wordpress blog) using the standard CPANEL FANTASTICO setup. How would I set it up, then stop any spidering from happening in the search engines. I understand it wouldn't happen right away but eventually the search engines might find pages that would change, path to files may change and the overall structure of the site might be changed over the course of setting things up. I want to stop this from happening!

In order to view and test your site development you would need to publish the results online no? Would robots.txt work alone? Are there any other options to accomplish this.
#bing #google #indexing #question #stop #yahoo
  • Profile picture of the author Harrison Ortega
    After installing wordpress, just login to your dashboard, under the settings tab, click on "privacy" and select "I would like to block search engines". That will automatically create a robots.txt to block all bots. When your site is ready to be indexed, then just go to the same place and select the other option, which it is to allow the bots to crawl your site again.


    Originally Posted by nelsonbiglar View Post

    I want to get some info on setting up a webite (wordpress blog) using the standard CPANEL FANTASTICO setup. How would I set it up, then stop any spidering from happening in the search engines. I understand it wouldn't happen right away but eventually the search engines might find pages that would change, path to files may change and the overall structure of the site might be changed over the course of setting things up. I want to stop this from happening!

    In order to view and test your site development you would need to publish the results online no? Would robots.txt work alone? Are there any other options to accomplish this.
    Originally Posted by nelsonbiglar View Post

    I want to get some info on setting up a webite (wordpress blog) using the standard CPANEL FANTASTICO setup. How would I set it up, then stop any spidering from happening in the search engines. I understand it wouldn't happen right away but eventually the search engines might find pages that would change, path to files may change and the overall structure of the site might be changed over the course of setting things up. I want to stop this from happening!

    In order to view and test your site development you would need to publish the results online no? Would robots.txt work alone? Are there any other options to accomplish this.
    Signature
    NJ web design / NJ Web Designer. MY Wordpress portfolio. 10 years of HTML/CSS - 6 years developing professional Wordpress websites. Currently not available for services.
    {{ DiscussionBoard.errors[2164672].message }}
  • Profile picture of the author <CrGeary.com/>
    In the robots.txt file if you have this:

    Code:
    User-agent: *
Disallow: /
    That will stop the MAJOR search engines crawling your site, (not the smaller ones, because they dont all use the robots .txt file)
    --
    In the above script, the asteriks (*) means ALL, and the slash (/) means the root of your site.

    ---
    Also, you can test your site offline (even a wordpress site), if you download WAMP server or easyPHP or something similar (its a web server with apache / php / mysql for windows) (unless you have a mac, in which case you will have to find a different one)
    {{ DiscussionBoard.errors[2168079].message }}
  • Profile picture of the author NetMan
    Both the above methods are good, just simpler from inside the wp dashboard
    {{ DiscussionBoard.errors[2168131].message }}
    • Profile picture of the author nelsonbiglar
      Thanks guys, I new robot.txt worked well enough, wasn't too sure about the wordpress dashboard option. Also the WAMP option sounds interesting!
      Signature

      On the other side:
      www.fishingnorthernontario.com

      {{ DiscussionBoard.errors[2168373].message }}

Trending Topics