How do I code a backlink checker tool?

by 4 replies
6
I thought of posting this into the programming section, but I thought I'd get a better response here due to the higher volume of people.

Right, so.. any clue on how I'd go about making my own backlink checker tool?
It seems sites like backlinkwatch gather their data from the existing resources of a crawler with a large index (seemingly yahoo, in this case).

Basically, I'm wondering if I can use the Google API (which I have experience with) the Yahoo API (which I don't have a clue in hell about) and whatever else I can find (Microsoft and other folks?) to harvest info on the links to a particular site.

If I can accumulate this data, I can conglomerate it all and weed out duplicate URLs, then render it in a nice table with fields like dofollow, pagePR, domainPR and a few others that I could guess domain authority with.

(PS I am trying to make a free tool)

So, questions:
1) Am I going about this in the right way?
2) Can anyone give me a hint on how to use these API's for my purpose?
3) Are their other sources (crawlers) that I should investigate?
#search engine optimization #backlink #checker #code #tool
  • [DELETED]
  • You can check back links using various tools these tools are available on the internet for free please make sure you use authenticated tools. hope it will work for you.
  • Tried vworker or Rent a Coder? Surely someone can recommend a good coder. Or do people hold them as tightly as their keywords?
  • Sorry, I don't think I was clear on how I want to go about this.

    I'm not looking for a backlink checking tool or a programmer to hire, I'm looking for help on how to conceptualize how these sorts of tools work..
  • Umm...I've written a very powerful backlink gatherer. It runs off Yahoo Explorer. It classifies links(articles, forums, etc), checks anchor text etc. Its part of a larger package so I'm not ready to release it just yet.

    I don't believe there are APIs for backlinks. You hit the web pages directly, with some delays. If you are a seasoned programmer you should know how to scrape web pages with the DOM or regular expressions.

    What language do you want to do this in?
Join the discussion

Next Topics on Trending Feed

  • 6

    How do I code a backlink checker tool?

    I thought of posting this into the programming section, but I thought I'd get a better response here due to the higher volume of people. Right, so.. any clue on how I'd go about making my own backlink checker tool?