What crawler software do you prefer and why?

5 replies
  • SEO
  • |
I am trying Screaming Frog and Wildshark. Both look amazing, but I would like to know your experience with them.
#crawler #prefer #software
  • Profile picture of the author hinner
    not sure what you're using it for, but I like xenu, because it's free
    Signature
    Equip your SEO arsenal with our High Quality Domains.

    Only the best quality domains available.
    {{ DiscussionBoard.errors[9937372].message }}
  • Profile picture of the author fpforum
    From the looks of it, there are a number of free websites out there which do what Wildshark does...SEOSiteCheckup and SEMRush would give pretty much the same stuff.
    Signature
    Free SEO Software - Start Improving Your Rankings Today!
    Windows VPS Servers - Cheap Windows VPS Servers With Instant Setup!
    {{ DiscussionBoard.errors[9938197].message }}
    • Profile picture of the author CDiamond
      Are you using it for data mining (scraping)?
      Signature

      Charles
      It is better to buy a small, beautiful diamond than a big ugly one.

      {{ DiscussionBoard.errors[9938226].message }}
  • Profile picture of the author DivyaRai
    SEMrush and ahrefs tool going to help you a lot to see your website performace, I have downloaded Linkassistant tool, its also one of the best tool to have.
    {{ DiscussionBoard.errors[9938292].message }}
  • Profile picture of the author WildsharkSEO
    The Wildshark SEO Spider Tool is 100% FREE with zero restrictions. You are able to crawl websites of any size.

    Our tool also includes a unique error overview feature that tells you what error you have, how many and exactly where they are. You can even create an error overview report fully branded to your company if you like.

    We have developed our spider tool with on-page optimisation in mind. We feel that it is far more tailored to an SEO professional that is performing on-page tasks day in - day out.

    Go and check it out sor yourselves:
    Wildshark SEO Spider Tool: Crawl Unlimited Pages

    Our free tool will also be tweaked according to the feedback and function requests we receive.
    Signature

    Wildshark is an inbound lead generation agency. We also develop quality SEO tools. Check out our FREE SEO Spider Tool

    {{ DiscussionBoard.errors[9941020].message }}

Trending Topics