Public Proxies - Do You Have To Replace Them Everyday?

19 replies
  • SEO
  • |
For some reason I'm just catching onto this.

But for the 8-9 months I've owned scrapebox, I've never felt like it worked the right way. Like it was never capable of returning thousands upon thousands of urls and my success rate was always super low.

However, I never understood how important proxies actually were. I'd copy over maybe 40-50, and 90% of the time wouldn't even test them. Which I now realize is really stupid.

What I've been doing lately, is getting lists of thousands of public proxies (from BHW) and testing them everyday. Then I filter out all the ones that passed google. I've always kinda knew that this was important... I just had no idea how important it really is.

Well today I was blown away to see it harvest over 100,000 urls. And it did it REALLY FAST. Only took a few hours. The most urls I've ever harvested at once has been around 6,000.

Also, my highest success rate for fast posting has usually been about 10%. A lot of times its even less than that, which has always bothered me. Today my success rate was around 50% which blew my mind. I've never seen it work so well before in my life.

BTW, I never use fast posting for my money site I usually just blast videos. Or I'll filter high pr blogs to manually comment on.

But my question is this.

To keep scrapebox working so well, I have to test a few thousand proxies everyday? Because it seems the following day, only about 20-30% of the proxies will still work.

And for people who use public proxies, do you save your old proxy lists? Like will they eventually work again or should I be deleting my lists once they burn out?

I had no idea that scrapebox needs this many new proxies everyday just to work right. And its pretty crazy to wonder where the hell they all come from in the first place.

-Red
#everyday #proxies #public #replace
  • Profile picture of the author ilee
    What I do is scrape a bunch of proxies, do what I need to do, and then on the next day I'll test the proxies from the previous day and using the few that have survived, I'll scrape more. The failed proxies are deleted, ain't nobody got time for them.
    Signature
    --~***~--


    --~***~--
    {{ DiscussionBoard.errors[7973142].message }}
  • Profile picture of the author mekdroid
    Just out of curiosity, what do you do about captchas? Do you use a captcha-solving service, or just avoid sites with captchas?
    Signature

    Temporary occupation of some valuable piece of technical real-estate, followed by a negotiated retreat with full coffers

    {{ DiscussionBoard.errors[7973173].message }}
  • Profile picture of the author extremeboy
    Take paid public proxies service around the web to get rid of time wasting and take private ones for posting works best
    {{ DiscussionBoard.errors[7973298].message }}
  • Profile picture of the author MikeFriedman
    If you are going to use public ones, you need to harvest and test every few hours
    Better alternative is to pick up 50 private proxies. Worth every penny.
    Signature

    For SEO news, discussions, tactics, and more.
    {{ DiscussionBoard.errors[7973395].message }}
  • Profile picture of the author JSProjects
    Every Sunday morning I plug in a proxy footprint that I came up with into the search harvester, choose Google as the engine, and tick the "results from 7 days" radio button. This usually gives me about 400-600 URLs with proxies on them.

    Then, I use the proxy harvester to grab all of the proxies from these URLs. Generally end up with 20-40k.

    Finally, I run all of these through the proxy checker and end up with about 3,000-6,000 working proxies. (About 250-500 pass the "Google" test at any given time.) This is the list that I use throughout the week, making sure to check it every so often.

    If you're going to make heavy use of the harvester you NEED a LOT of proxies.
    {{ DiscussionBoard.errors[7973447].message }}
  • Profile picture of the author proxygo
    hello xtreem boy u here as well.what you need minimum is10 private proxies for posting public proxies for scraping,but heres the catch with public scraped proxies and why they die so fast.there are several tools on the market thatscrape public proxies.the problem will always be in the fact they all look different to use but,all do the same job [ scrape public proxies ] so all the tools out there reguardless of there name all do the same job, scrape public proxies.now x that by thousands of people all owning those scrapers and what doyou get ? fast dying proxies due to everyone scrapingthe same proxies.me personally ive port scanned public proxies for 10 yrs, the last 4 of them doing services for s/box on bhw - of wich i am also bhw highest poster.twice a day every day for 4 yrs ihave port scanned 3/4k google passed proxies and never everfailed,port scanned public proxies will last 10x longer than scraped public proxies because scrapers cant scrape port scanned proxies,they have tobe scanned via ip address blocks, doing this i have supported over 600 subs on bhw and never done a single refundhttp://s16.postimg.org/3k2mdyq91/tyu.jpg
    {{ DiscussionBoard.errors[8022014].message }}
  • Profile picture of the author JSProjects
    Another alternative, if you're willing to spend about $5-$10 a month, is to sign up for a VPN that lets you switch servers. "Private Internet Access" is one that does. Just a matter of switching to a new server if your IP gets soft blocked by the SE's. Well worth the cost as it saves a TON of time instead of having to constantly harvest proxies.
    {{ DiscussionBoard.errors[8022136].message }}
  • Profile picture of the author Kayster13
    Thanks for the info regarding IP addresses. I love your insights.
    {{ DiscussionBoard.errors[8022184].message }}
  • Profile picture of the author Dokemion
    100% of the time I don't test my proxy list...

    To save time harvesting just visit this page

    hidemyass dot com/proxy-list/ <<--- (I don't work for them)

    Copy everything on that list paste it on excel drag again but this time only copy the IPs and it's Ports then paste it on notepad then copy everything that is paste on notepad then paste in scrapebox proxy box.

    Since the proxy list changes almost every minute you don't have to worry about harvesting and you don't have to worry about testing them too.

    Those proxies you put in the proxy box of scrapebox will be banned in a few days or a week max checking them often is a waste of time and effort.

    Bunch of newbs! Just kiddin` guys..
    Signature

    Contact me for any SEO Services you need I'm glad to be of your service.

    {{ DiscussionBoard.errors[8022217].message }}
  • Profile picture of the author squadron
    I scrape and test new proxies every process, not every day. I usually get a better than 45% successful post rate.

    It takes a bit longer, but you get much better results. I learned the hard way I'm afraid

    It may be worth the extra expense to get 2 copies of Scrapebox, one for harvesting and testing proxies, one for the other tasks.
    {{ DiscussionBoard.errors[8022346].message }}
    • Profile picture of the author JSProjects
      Originally Posted by squadron View Post

      I scrape and test new proxies every process, not every day. I usually get a better than 45% successful post rate.

      It takes a bit longer, but you get much better results. I learned the hard way I'm afraid

      It may be worth the extra expense to get 2 copies of Scrapebox, one for harvesting and testing proxies, one for the other tasks.
      You'll get a MUCH better success rate if you used private proxies for posting.
      {{ DiscussionBoard.errors[8024644].message }}
  • Profile picture of the author dids
    I grab new proxies for every scrape in scrapebox if you purchase the schedule plugin its really easy to setup
    {{ DiscussionBoard.errors[8022381].message }}
  • Profile picture of the author Lanii
    For scrapebox, its worth to use some time to harvest public proxies daily.
    Google bans IP's that scrapes content so thats why its better to use public proxies to do all scraping work.

    I have found many times public proxies that works for more than 3 weeks and quality is same as private proxies, so I would check daily old proxy list and merge it with new list.
    {{ DiscussionBoard.errors[8022594].message }}
  • Profile picture of the author RedShifted
    Well this is what confuses me about private proxies.

    Say I buy 50 private proxies.

    Then the next day 70% of them are gone... its kind of a waste of money no?

    I just don't understand how or when google decides to ban proxies.

    So you guys are saying, even if I harvest on those same private proxies for 30 days... they won't get banned? Or does a certain % get banned and thats why you replace them every month? I think my real question is, are they GUARANTEED to last a month? Because the banning with public proxies seems extremely random.
    {{ DiscussionBoard.errors[8024875].message }}
    • Profile picture of the author qw3rty
      Originally Posted by RedShifted View Post

      Well this is what confuses me about private proxies.

      Say I buy 50 private proxies.

      Then the next day 70% of them are gone... its kind of a waste of money no?

      I just don't understand how or when google decides to ban proxies.

      So you guys are saying, even if I harvest on those same private proxies for 30 days... they won't get banned? Or does a certain % get banned and thats why you replace them every month? I think my real question is, are they GUARANTEED to last a month? Because the banning with public proxies seems extremely random.
      If you get private proxies from providers who allow and even encourage to use their proxies with Scrapebox then you'll be OK. When a proxy gets banned it doesn't take 30 days for Google to unban it, and if your proxy provider knows you'll be using them for Scrapebox they shouldn't have any problem providing you with proxies that are good to replace the ones you burn.

      I have noticed that there are fewer and fewer proxy providers that allow Scrapebox to be used with them. It must be becoming more problematic these days for those guys.
      {{ DiscussionBoard.errors[8025006].message }}
      • Profile picture of the author Dokemion
        Originally Posted by qw3rty View Post

        If you get private proxies from providers who allow and even encourage to use their proxies with Scrapebox then you'll be OK. When a proxy gets banned it doesn't take 30 days for Google to unban it, and if your proxy provider knows you'll be using them for Scrapebox they shouldn't have any problem providing you with proxies that are good to replace the ones you burn.

        I have noticed that there are fewer and fewer proxy providers that allow Scrapebox to be used with them. It must be becoming more problematic these days for those guys.
        What is your proof saying that it doesn't take 30 days for Google to unban a proxy?
        Signature

        Contact me for any SEO Services you need I'm glad to be of your service.

        {{ DiscussionBoard.errors[8025691].message }}
        • Profile picture of the author JSProjects
          Originally Posted by Dokemion View Post

          What is your proof saying that it doesn't take 30 days for Google to unban a proxy?
          Experience?

          I've always used proxies from Buy proxies for scrapebox, xrumer, pinternet, ticketmaster| where to buy proxies and, at worst, they tend to get banned from using the search harvester for a little less than a day.

          Recently though, I've switched to using a VPN which lets me change my server / IP with a few clicks.
          {{ DiscussionBoard.errors[8025859].message }}
        • Profile picture of the author qw3rty
          Originally Posted by Dokemion View Post

          What is your proof saying that it doesn't take 30 days for Google to unban a proxy?
          I use proxies all the time with Scrapebox and observed how they work. I've found really good public proxies that would consistently work during certain times of the day that I would burn. Then after a day or two they would work with Google again.
          {{ DiscussionBoard.errors[8028392].message }}
    • Profile picture of the author JSProjects
      Originally Posted by RedShifted View Post

      Well this is what confuses me about private proxies.

      Say I buy 50 private proxies.

      Then the next day 70% of them are gone... its kind of a waste of money no?

      I just don't understand how or when google decides to ban proxies.

      So you guys are saying, even if I harvest on those same private proxies for 30 days... they won't get banned? Or does a certain % get banned and thats why you replace them every month? I think my real question is, are they GUARANTEED to last a month? Because the banning with public proxies seems extremely random.
      Google will "soft" ban them for a little bit. (Usually no more than a day.) But they should work just fine for everything else.
      {{ DiscussionBoard.errors[8025847].message }}

Trending Topics