I want edit Robot.txt of my website anybody wih the tips

2 replies
  • WEB DESIGN
  • |
I hosted my WordPress website on Google cloud hosting since then I am unable to edit robot.txt in order to activated it for search Engine
#edit #robottxt #tips #website #wih
Avatar of Unregistered
  • Profile picture of the author Ethan Root
    Yes you can edit your robot.tx file in yoast tools in word press.
    {{ DiscussionBoard.errors[11357222].message }}
  • Profile picture of the author Daniel Dixon
    Hello Zenith,

    I know you found the answer to your question, but just so anyone else reading is clear...


    Website automatically creates a blank robots.txt file for your site. If you look at your robots.txt file (yourdomainhere.com/robots.txt), you'll see text similar to this:

    User-agent: *
    Disallow: /ajax/
    Disallow: /apps/


    The user-agent: * means that the rules in this file applies to all robots. The "Disallow: /ajax/" and "Disallow: /apps/ " lines mean that robots cannot index any files you've uploaded to your store to sell (this is a default setting, so you'll see this line even if you're not using the Weebly store features).

    If nothing else is listed, it means that nothing else on your site is disallowed. If there were anything being blocked, it would show up after the second "disallow" but as long as that is blank, none of your pages are blocked and search engines can find your site.

    If you want to change this and block search engines from indexing your site, go to Settings > SEO and select "Hide site from search engines." Then Save and Publish.

    The robots.txt file for a site that is completely hidden from search would look like this:

    User-agent: *
    Disallow: /
    I hope this above answer helpful for you,

    Regards,
    Daniel
    Techtiq Solutions,
    {{ DiscussionBoard.errors[11357412].message }}
Avatar of Unregistered

Trending Topics