7 {{ upvoteCount | shortNum }}
7 {{ upvoteCount | shortNum }}

How to prepare XML Sitemap & robots.txt

by Vednor
6 replies
  • WEB DESIGN
    • |
Hello fellow Warriors!

When I first started my website 5 years back, I used a 3rd party site to generate a XML sitemap. But it only allowed 500 pages, whereas my site has around 5000 pages in it, and increasing every single day. So both Google and Bing don't recognize the XML sitemap I've uploaded in my webmaster tools account anymore. Worst part is that, Google has only indexed 180 pages (170 of them are invalid pages), and Bing has indexed 50 pages (all valid).

I didn't realize this would be a serious issue, until I figured that 3rd party site indexed tons of invalid pages, and I keep seeing warning messages in Google webmaster tools. The developer I hired for my site's maintenance doesn't know how to prepare such sitemap. I also read about the importance of having a robots.txt file to ease the search bots.

Now, do you guys know any such tool that can help me prepare both the XML Sitemap & robots.txt. Or any freelancer who'd take such work? Please recommend.

Highly appreciate your expert opinions. Many thanks.

Happy Holidays!
#bing #google #prepare #robotstxt #sitemap #xml
  • Profile picture of the author reddys
    i can't see your site map? can you say your sitemap location?
    you located your site map at webmaster tools with this link (http://www.noobfeed.com/sitemap.xml) .
    If you are using wordpress then there are some site map generator plugins. try them.
    after you generated sitemap then give the correct path link in webmaster tools. your current sitemap.xml link in webmaster tools is wrong. that's why you seeing the error in webmaster tools.
    Signature
    For those who are searching for Direct mobile CPI offers please contact me at skype: madi.webz
    {{ DiscussionBoard.errors[8801732].message }}
    • Profile picture of the author Vednor
      Originally Posted by reddys View Post

      i can't see your site map? can you say your sitemap location?
      you located your site map at webmaster tools with this link (http://www.noobfeed.com/sitemap.xml) .
      If you are using wordpress then there are some site map generator plugins. try them.
      after you generated sitemap then give the correct path link in webmaster tools. your current sitemap.xml link in webmaster tools is wrong. that's why you seeing the error in webmaster tools.
      I've removed that 3rd party generated sitemap after realizing that it has many invalid links. This is why I'm looking for someone who can make a new one. And, it's not a wordpress site.
      Signature
      Gaming News | Twitter
      {{ DiscussionBoard.errors[8801774].message }}
      • Profile picture of the author reddys
        Originally Posted by Vednor View Post

        I've removed that 3rd party generated sitemap after realizing that it has many invalid links. This is why I'm looking for someone who can make a new one. And, it's not a wordpress site.
        i made sitemap of your site.. send your mail id. i will mail you.
        if you need any other Help Contact me: madi(dot)webz(at)gmail(dot)com
        im glad to help you
        Thanks
        Signature
        For those who are searching for Direct mobile CPI offers please contact me at skype: madi.webz
        {{ DiscussionBoard.errors[8802164].message }}
        • Profile picture of the author Vednor
          Originally Posted by reddys View Post

          oh..ok. madi(dot)webz(at)gmail(dot)com
          im glad to help you
          Thanks mate. I'll surely leave an email to this address.
          Signature
          Gaming News | Twitter
          {{ DiscussionBoard.errors[8802250].message }}
  • Profile picture of the author nettiapina
    There are several free sitemap generators, and I think one of them would work just fine. Unfortunately I can't remember which one I've used in the past.

    Currently using Screaming Frog SEO Spider, but that's a paid tool.
    Signature
    Links in signature will not help your SEO. Not on this site, and not on any other forum.
    Who told me this? An ex Google web spam engineer.

    What's your excuse?
    {{ DiscussionBoard.errors[8802284].message }}
    • Profile picture of the author Vednor
      Originally Posted by nettiapina View Post

      There are several free sitemap generators, and I think one of them would work just fine. Unfortunately I can't remember which one I've used in the past.

      Currently using Screaming Frog SEO Spider, but that's a paid tool.
      I don't have problems with paid services. So please recommend if you know any reliable one.
      Signature
      Gaming News | Twitter
      {{ DiscussionBoard.errors[8802336].message }}

Trending Topics