6 {{ upvoteCount | shortNum }}
6 {{ upvoteCount | shortNum }}

Robots.txt & Linkbuilding

by SEODB
6 replies
  • SEO
    • |
Hi all,

We want to do linkbuilding for ditters.nl.
Can you have a look at the robots.txt (www.ditters.nl/robots.txt) ?

I would like an answer to the question: Is this robots.txt preventing from getting a higher ranking in Google with linkbuilding?
Are changes needed? If so, what? (Please be aware of the last line in the robots.txt.)

Thanks for your reply!
#linkbuilding #robotstxt
  • Profile picture of the author lsiontee
    I think you are using too much data. On the other hand it looks like you are allowing Googlebot to crawl your page. For questions, read this, this can help: The Web Robots Pages ^_^
    {{ DiscussionBoard.errors[10599480].message }}
  • Profile picture of the author siriinnovations4
    In my view Robots.txt help to build the traffic for the website and improve the ranking. It avoids the spam links and crawls the website traffic and generate the backlinks.
    {{ DiscussionBoard.errors[10599604].message }}
    • Profile picture of the author MikeFriedman
      Originally Posted by siriinnovations4 View Post

      In my view Robots.txt help to build the traffic for the website and improve the ranking. It avoids the spam links and crawls the website traffic and generate the backlinks.
      What you just said is so far from the truth.
      Signature

      For SEO news, discussions, tactics, and more.
      {{ DiscussionBoard.errors[10600220].message }}
  • Profile picture of the author joeyJr
    You are designing a website too picky now!
    You do not need to worry about that robots.txt file! Will not do much to affect Google's ranking at where! In my opinion your robots.txt to block links to spam, protect your website!
    If it's useful for you! please press button "Thanks"!.Good day!
    Signature
    IF Review Business intelligence from online product reviews at here
    {{ DiscussionBoard.errors[10600072].message }}
  • Profile picture of the author yukon
    Banned
    User-agent: Googlebot
    Disallow:

    User-agent: Googlebot-Mobile
    Disallow:

    User-agent: Googlebot-Video
    Disallow:

    User-agent: Googlebot-Image
    Disallow:

    User-agent: Googlebot-News
    Disallow:


    I have no idea why anyone would have this code in their robots.txt & try to rank a page at the same time.

    I know the disallow isn't pointing to a URL but you're setting yourself up for a counterproductive fail just having that code in the robots.txt file.

    If you don't specifically block Googlebot then the page will be indexed. Something as simple as a forward slash after that disallow will deindex the whole site (example below). Remove the useless code.



    User-agent: Googlebot
    Disallow: /
    {{ DiscussionBoard.errors[10600330].message }}
  • Profile picture of the author SEODB
    Thanks all for the replies!

    We understand that the website is still listed in Google.
    But does it also prefer link juice by creating new links / doing linkbuilding?
    {{ DiscussionBoard.errors[10604700].message }}

Trending Topics