Link validator? (Desktop preferred)

24 replies
Probably something simple and obvious that I'm missing, but if so.,.. I'm missing it.

Anyone got a recommendation for a piece of software or a browser trick that will let me feed in an HTML page (or just a list of links) and return a file with any dead ones that might be included? I know I could use online link checkers. I would prefer something that doesn't involve posting the list anywhere.

PC, Mac, or Linux. Doesn't matter.


Paul
#desktop #link #preferred #validator
  • Profile picture of the author fin
    Scrapebox, no?
    {{ DiscussionBoard.errors[7067725].message }}
  • Profile picture of the author Joshua Rigley
    Banned
    Found a few that might be what you're looking for.

    Link checker tools
    http://misvblog.com/desktop-crawler-...-link-checker/
    Best 2 Broken Link Checkers For Mac And Windows

    LOL, you should hire me to be your personal researcher or something. :p

    Hope that helps.
    {{ DiscussionBoard.errors[7067751].message }}
  • Profile picture of the author Brandon Tanner
    Paul,

    This is a pretty good one, IMO. Produces a very detailed report, with all the info you need.
    Signature

    {{ DiscussionBoard.errors[7067765].message }}
  • Profile picture of the author Robert Michael
    Yeah, Scrapebox does that (and a ton of other things.. lol)

    Here is their discount link if you decide to try it out:

    BHW - ScrapeBox (not an affiliate link, they dont even have an affiliate program)
    {{ DiscussionBoard.errors[7067779].message }}
    • Profile picture of the author Paul Myers
      Thanks. I was looking for an "I've used this and it works" sort of response. Sounds like Brandon's used Xenu, so... We'll test it.

      Scrapebox? Seriously? There's no way I'd ever install that sort of software anywhere near my networked machines. And it's a bit overkill for this kind of project, no? All I want to do with it is keep my personal resource lists up to date.


      Paul
      Signature
      .
      Stop by Paul's Pub - my little hangout on Facebook.

      {{ DiscussionBoard.errors[7067875].message }}
      • Profile picture of the author Andyhenry
        Originally Posted by Paul Myers View Post

        Thanks. I was looking for an "I've used this and it works" sort of response. Sounds like Brandon's used Xenu, so... We'll test it.

        Paul
        Yep - I test all new sites with Xenu - been using it for many years and it gets my vote too.

        Andy
        Signature

        nothing to see here.

        {{ DiscussionBoard.errors[7067893].message }}
      • Profile picture of the author Kurt
        Originally Posted by Paul Myers View Post

        Thanks. I was looking for an "I've used this and it works" sort of response. Sounds like Brandon's used Xenu, so... We'll test it.

        Scrapebox? Seriously? There's no way I'd ever install that sort of software anywhere near my networked machines. And it's a bit overkill for this kind of project, no? All I want to do with it is keep my personal resource lists up to date.


        Paul

        Yes, seriously Scrapebox. Why anyone would be afraid to install "that sort" of software anywhere near your network?

        Scrapebox does have some spam features. On the other hand, it is also jam-packed full of totally whitehat research resources, including the "Alive Check" which quickly tests a list of URLs to see if they are "alive or dead".

        I do agree it will be overkill for simply checking URLs to see if they are alive. However, for many marketers Scrapebox also includes many other features with an assortment of benefits. One of the main benefits is to be able to do keyword research for multiple keywords at once.

        I consider Scrapebox to be one of my most essential programs and I've NEVER used it to spam blogs with links.
        Signature
        Discover the fastest and easiest ways to create your own valuable products.
        Tons of FREE Public Domain content you can use to make your own content, PLR, digital and POD products.
        {{ DiscussionBoard.errors[7069951].message }}
        • Profile picture of the author Paul Myers
          Kurt,
          Scrapebox does have some spam features.
          And I refuse to support the developers of spamware.

          It's not uncommon to ignore the fact that spammers need a lot of the same info that legitimate marketers need. That gives rise to the rationalization that it's just a tool, so it's okay.

          I contend, however, that by supporting the tool with those features included, you are encouraging its continued development and sale, which perpetuates the abuse it's so often used for.

          I recently suspended 3 separate WSOs because they included features that actively encouraged spamming. They scraped email addresses and automatically mailed the owners of those addresses. Each of the sellers had to change their copy and software in order to get the offers re-instated.

          Each of the tools were hugely useful without the spamming capabilities. Guess which features the majority of people here would have used the most?

          I'm sorry, but I LIKE being able to use LinkedIn without getting bombarded by garbage because of it. I LIKE the fact that, other than a few untargeted invites, I can use Facebook without being hammered by idiots who haven't enough clue to know that sending me MLM spam isn't a productive use of anyone's time.

          I see, every day, the damage that a small handful of scumbags can do when they get their hands on tools for the automated sending of unsolicited marketing messages. Sure, some tools are neutral in use, and I go along with the "It's just a tool" argument for those. But anything that has any features designed specifically for spamming?

          If you support those tools, you're supporting their abuse. Even if you never participate actively in that abuse yourself.

          It's like the difference between guns and guns with silencers. There are lots of legitimate uses for guns. Silencers are not, however, something a legitimate civilian gun owner should ever need.


          Paul
          Signature
          .
          Stop by Paul's Pub - my little hangout on Facebook.

          {{ DiscussionBoard.errors[7071477].message }}
          • Profile picture of the author Chris Silvey
            Originally Posted by Paul Myers View Post

            Kurt,And I refuse to support the developers of spamware.

            It's not uncommon to ignore the fact that spammers need a lot of the same info that legitimate marketers need. That gives rise to the rationalization that it's just a tool, so it's okay.

            I contend, however, that by supporting the tool with those features included, you are encouraging its continued development and sale, which perpetuates the abuse it's so often used for.

            I recently suspended 3 separate WSOs because they included features that actively encouraged spamming. They scraped email addresses and automatically mailed the owners of those addresses. Each of the sellers had to change their copy and software in order to get the offers re-instated.

            Each of the tools were hugely useful without the spamming capabilities. Guess which features the majority of people here would have used the most?

            I'm sorry, but I LIKE being able to use LinkedIn without getting bombarded by garbage because of it. I LIKE the fact that, other than a few untargeted invites, I can use Facebook without being hammered by idiots who haven't enough clue to know that sending me MLM spam isn't a productive use of anyone's time.

            I see, every day, the damage that a small handful of scumbags can do when they get their hands on tools for the automated sending of unsolicited marketing messages. Sure, some tools are neutral in use, and I go along with the "It's just a tool" argument for those. But anything that has any features designed specifically for spamming?

            If you support those tools, you're supporting their abuse. Even if you never participate actively in that abuse yourself.

            It's like the difference between guns and guns with silencers. There are lots of legitimate uses for guns. Silencers are not, however, something a legitimate civilian gun owner should ever need.


            Paul
            I make good bank on spammers. I love spam email now. That is to say receiving it.
            Signature
            WP Animate - Increases Conversions & Clicks!
            Create Amazing CSS3 Animations in just a few Clicks - New!

            WPHeadline.net - Create Blazing Headlines in just a few clicks. Updated to WordPress 4.1.1
            {{ DiscussionBoard.errors[7071499].message }}
          • Profile picture of the author Andyhenry
            Originally Posted by Paul Myers View Post

            It's like the difference between guns and guns with silencers. There are lots of legitimate uses for guns. Silencers are not, however, something a legitimate civilian gun owner should ever need.


            Paul
            Damn, I just got a gun with a silencer - The silencer is so that the noise does not disturb my neighbors, no other reason. Well actually, I think it looks cool too.
            Signature

            nothing to see here.

            {{ DiscussionBoard.errors[7072326].message }}
          • Profile picture of the author Kurt
            Originally Posted by Paul Myers View Post

            Kurt,And I refuse to support the developers of spamware.

            It's not uncommon to ignore the fact that spammers need a lot of the same info that legitimate marketers need. That gives rise to the rationalization that it's just a tool, so it's okay.

            I contend, however, that by supporting the tool with those features included, you are encouraging its continued development and sale, which perpetuates the abuse it's so often used for.

            I recently suspended 3 separate WSOs because they included features that actively encouraged spamming. They scraped email addresses and automatically mailed the owners of those addresses. Each of the sellers had to change their copy and software in order to get the offers re-instated.

            Each of the tools were hugely useful without the spamming capabilities. Guess which features the majority of people here would have used the most?

            I'm sorry, but I LIKE being able to use LinkedIn without getting bombarded by garbage because of it. I LIKE the fact that, other than a few untargeted invites, I can use Facebook without being hammered by idiots who haven't enough clue to know that sending me MLM spam isn't a productive use of anyone's time.

            I see, every day, the damage that a small handful of scumbags can do when they get their hands on tools for the automated sending of unsolicited marketing messages. Sure, some tools are neutral in use, and I go along with the "It's just a tool" argument for those. But anything that has any features designed specifically for spamming?

            If you support those tools, you're supporting their abuse. Even if you never participate actively in that abuse yourself.

            It's like the difference between guns and guns with silencers. There are lots of legitimate uses for guns. Silencers are not, however, something a legitimate civilian gun owner should ever need.


            Paul

            First, my question was about you being "afraid". You changed the subject.

            Second, I'm not responsible for the actions of others. Granted, Scrapebox does have spam features.

            And I disagree with your opinion I am supporting spammers. They don't have to use the program to spam, it's their decision to do so.

            By publicly posting that it has features OTHER than to spam and that I don't use Scrapebox to spam nor do I encourage spamming with Scrapebox is good enough for my conscious and I can live with myself, and continue recommending Scrapebox as a legit tool, while disagreeing with their spamming feature, which in reality is about 5% of the total features.

            As far as your gun/silencer analogy...I don't like analogies to make a point. Anyone with just a little creativity can make up a scenario to "prove" their point.

            PS...It would seem a silencer would be "legitimately" useful for someone that's duck hunting.
            Signature
            Discover the fastest and easiest ways to create your own valuable products.
            Tons of FREE Public Domain content you can use to make your own content, PLR, digital and POD products.
            {{ DiscussionBoard.errors[7072461].message }}
          • Profile picture of the author Robert Michael
            It's like the difference between guns and guns with silencers. There are lots of legitimate uses for guns. Silencers are not, however, something a legitimate civilian gun owner should ever need.
            If some moron decides they are feeling lucky & breaks in to my house in the middle of the night and I have to shoot them, I shouldn't have to blow out my eardrums just because of some idiotic burglar..

            And I can't be the only one who thinks that..

            I have hardwood floors & LOTS of free space - meaning lots of echoing.

            If I shoot a gun inside this house, my eardrums will be blown. My girl's eardrums will be blown. Hell, I can't even imagine what would happen to my poor lil dog's eardrums, due to their sensitive hearing in the first place..

            That is a perfect reason for civilians to own a suppressor, and that is just one of them! lol
            {{ DiscussionBoard.errors[7075335].message }}
  • Profile picture of the author John Romaine
    Paul, if I recall correctly, I remember running that Xenu on a site I owned years ago, and it absolutely hammered it. It also threw out my analytical data. (eg 150,000 uniques within an hour)

    It was a considerably large site, and perhaps theyve updated the software since - but thought I'd mention it anyway.
    Signature

    BS free SEO services, training and advice - SEO Point

    {{ DiscussionBoard.errors[7067894].message }}
  • Profile picture of the author Paul Myers
    John,

    I'm going to be testing files on my local machine, so there won't be any server impact. It's only a few thousand links, so it shouldn't be too much of a load problem. I'll probably let it run while I'm out for breakfast or something.

    Thanks for the warning. I'll definitely avoid using that on any working sites. Probably best to keep the important links on those in a local file and test them that way.


    Paul
    Signature
    .
    Stop by Paul's Pub - my little hangout on Facebook.

    {{ DiscussionBoard.errors[7067930].message }}
    • Profile picture of the author John Romaine
      Originally Posted by Paul Myers View Post

      John,

      I'm going to be testing files on my local machine, so there won't be any server impact. It's only a few thousand links, so it shouldn't be too much of a load problem. I'll probably let it run while I'm out for breakfast or something.

      Thanks for the warning. I'll definitely avoid using that on any working sites. Probably best to keep the important links on those in a local file and test them that way.


      Paul
      Yeah, sorry Paul, I realised what I said once I posted it. I must've tested a live site? I cant remember man, it was about 7 years ago. I definitely remember the impact though
      Signature

      BS free SEO services, training and advice - SEO Point

      {{ DiscussionBoard.errors[7068001].message }}
      • Profile picture of the author Paul Myers
        John,
        Yeah, sorry Paul
        For what? Warning me about possibly DOSing myself?

        Please, make more 'mistakes' like that!


        Paul
        Signature
        .
        Stop by Paul's Pub - my little hangout on Facebook.

        {{ DiscussionBoard.errors[7068086].message }}
  • Profile picture of the author Niko A Berezkin
    My friend, Scrapebox is THE SEO utility kit. It allows you to check if your links have been indexed, it allows you to ping those links, it allows you to create RSS feeds of html pages which you can host on your site, it allows you to find expiring domains for you to buy, it allows you to as you requested see if links are alive or dead, it allows you to find high PR blogs and and your links there MANUALLY, not spamming, thus contributing to the conversation, and getting a valuable highly relevant backlink, which is potentially a traffic siphon also to your site. All quickly, easily, and effectively.

    People that USE scapebox to spam blogs are just going to land themselves penalties. This is a tool, a powerful tool. Saying that its just a spamming device is firstly untrue and secondly completely ignorant of its proper use and capabilities. end of rant.

    full disclosure, I use Scrapebox as part of my SEO arsenal everyday, and NOT FOR SPAMMING.
    {{ DiscussionBoard.errors[7071517].message }}
    • Profile picture of the author Paul Myers
      Nikita,
      My friend, Scrapebox is THE SEO utility kit. It allows you to [list of features]
      Did you notice above where I mentioned tools that were hugely useful without the spamming capabilities? Have you seen me say, anywhere, that it has no legitimate uses?

      It scrapes email addresses. What legitimate purpose is there for that? Do you not believe the people who use that function will far more often abuse it by sending spam than whatever edge case scenarios you might outline? Or do you define spam as "something other than what I send?"

      It automatically posts to blogs. That is a destructive function, which should get anyone using it tossed off the net.

      If it's not intended to be used for spamming, why are pure spammer functions built in?
      Saying that its just a spamming device is firstly untrue
      Exactly where did I say its functions were limited to "just" spamming? (Timesaving hint: Nowhere.)


      Paul
      Signature
      .
      Stop by Paul's Pub - my little hangout on Facebook.

      {{ DiscussionBoard.errors[7071615].message }}
      • Profile picture of the author Kurt
        Originally Posted by Paul Myers View Post

        It scrapes email addresses. What legitimate purpose is there for that? Do you not believe the people who use that function will far more often abuse it by sending spam than whatever edge case scenarios you might outline? Or do you define spam as "something other than what I send?"

        Paul
        Are you 100% sure about this? Because I don't see that feature in Scrapebox. It may be possible to use it to scrape email addresses, but there's no feature for email addresses that I can find and I'm not sure how you would gather email addresses using Scrapebox.

        Scrapebox can generate email addresses, but I don't see where it scrapes them. Am I missing something?

        If you are incorrect, it goes against everything you preach about making false accusations, as well as could be potentially libelous.

        Again, I'm not sure about the email scrapper thing, but I don't have to be positive because I'm not the one making the accusation.
        Signature
        Discover the fastest and easiest ways to create your own valuable products.
        Tons of FREE Public Domain content you can use to make your own content, PLR, digital and POD products.
        {{ DiscussionBoard.errors[7072541].message }}
        • Profile picture of the author Paul Myers
          First, my question was about you being "afraid". You changed the subject.
          Not quite. I ignored it, as it didn't apply.
          And I disagree with your opinion I am supporting spammers.
          That's not quite what I said. I said you were supporting the developers of spamware, which encourages them to continue to produce and distribute software that is used for spamming.

          Close, but not the same thing.

          I honestly don't care what percentage of the feature list the spamming options comprise. I see the damage that stuff does. And honestly, if it were really all that small a subset of the feature list in terms of usage, why is it such a big chunk of the sales copy?

          That product was created for the express purpose of spamming.
          PS...It would seem a silencer would be "legitimately" useful for someone that's duck hunting.
          Can't speak for anywhere else in the world, but I don't believe you can put a silencer on a shotgun, and I don't think you can legally use anything else for duck hunting in PA. Mind you, I haven't hunted with a gun in a longish time, so the rules may have changed but... I kind of doubt that one's any different now.
          If you are incorrect, it goes against everything you preach about making false accusations, as well as could be potentially libelous.
          Unless they're just incredibly sloppy in their product description, and mean it can be used to de-dupe an email list, it does.

          ScrapeBox – Harvest, Check, Ping, Post

          Under URL Collection and List Management. Note the "Grab Emails" function. Doesn't look like a de-duping thing to me.

          Either way, it's used for spamming blogs, and my thoughts on that aren't likely to change any time soon. It's a destructive practice which, in my opinion, should carry some sort of civil or criminal penalty.


          Paul
          Signature
          .
          Stop by Paul's Pub - my little hangout on Facebook.

          {{ DiscussionBoard.errors[7072809].message }}
  • Profile picture of the author The Copy Nazi
    Banned
    There are lots of legitimate uses for guns. Silencers are not, however, something a legitimate civilian gun owner should ever need.
    Dude...is shooting the neighbors moggies* who regularly crap on my lawn a "legitimate use" of a silencer? If so...point me to the store please.



    * Brit for pussycats.
    {{ DiscussionBoard.errors[7071835].message }}
  • Profile picture of the author CoachJohn
    I use a pc programme called Index Checker v2.0 by Andy Black sorry I don't have a link
    {{ DiscussionBoard.errors[7071874].message }}
  • Profile picture of the author WinstonTian
    Originally Posted by Paul Myers View Post

    Probably something simple and obvious that I'm missing, but if so.,.. I'm missing it.

    Anyone got a recommendation for a piece of software or a browser trick that will let me feed in an HTML page (or just a list of links) and return a file with any dead ones that might be included? I know I could use online link checkers. I would prefer something that doesn't involve posting the list anywhere.

    PC, Mac, or Linux. Doesn't matter.


    Paul
    Yep as mentioned, scrapebox works wonders.

    But you could use this open-source script instead: http://linkchecker.sourceforge.net/

    Just paste the links into a html document and that should do fine.
    Signature

    Cheers,
    Winston
    The Beginner's Doctor

    {{ DiscussionBoard.errors[7072747].message }}

Trending Topics