YellowPages Scraper project

12 replies
Hey there everybody,
figured I would post this here as it's probably the most relevant section to post this in (based on interest).

Anyhow, I'm currently working on a YellowPages scraper program (not uBot based, so a lot faster). I would just like to ask if anybody here would be interested in such a program, as I'm just building it for myself right now.

What kind of features would you like to see in such a program.
Just looking for some input thats all.

Cheers,

Chris
#project #scraper #yellowpages
  • I use a member's WSO , that I purchased here. It seems to work great. It also lets you scrape many other sources.

    Tommy
    Signature

    Solving Multimedia Expectations. AppleCreekMedia

    {{ DiscussionBoard.errors[2900933].message }}
  • Profile picture of the author Headfirst
    There are quite a few yp scrapers out there already. Are you sure you want to invest the time in making another? If it's unique in that field, what makes it so?
    {{ DiscussionBoard.errors[2900992].message }}
    • Profile picture of the author abnation
      It's not all that difficult to make and I enjoy coding quite a lot. So that's no biggie... I'm actually thinking about building a multi-functional scraper right now. Not limited to YP only. Basically, something that could scrape all kinds of platforms for business information. Probably give the user the ability to define and add platforms themselves.

      Looking for some input guys! What would you like to see in a program like that.

      Cheers,

      Chris
      {{ DiscussionBoard.errors[2901074].message }}
  • Profile picture of the author Quentin
    Obviously it would want to be International in that it could access from different country versions, export to CSV for manipulating, good table structure for getting data.

    Quentin
    {{ DiscussionBoard.errors[2902709].message }}
    • Profile picture of the author abnation
      Originally Posted by Quentin View Post

      Obviously it would want to be International in that it could access from different country versions, export to CSV for manipulating, good table structure for getting data.

      Quentin
      Hey Quentin,

      thanks for the suggestions. It already supports international directories and I'm currently working on an "import" feature. So that anybody could basically import a new directory for scraping. It currently exports simple .txt files with the addresses, email, etc. CSV is a great idea, I'll make sure to incorporate that.

      Cheers,
      Chris
      {{ DiscussionBoard.errors[2904425].message }}
  • Profile picture of the author carwra
    I haven't used a scraper before and this is just new to me. Can you please explain what are the features of your new scraper that make it better than other.
    {{ DiscussionBoard.errors[2906085].message }}
    • Profile picture of the author abnation
      Originally Posted by carwra View Post

      I haven't used a scraper before and this is just new to me. Can you please explain what are the features of your new scraper that make it better than other.
      Hey there,

      well this program would basically be used to scrape public records of businesses (including email addresses, business locations, phone numbers and so on) based on your specified keyword. The primal use would be lead generation I guess, but I wouldn't limit it to that only.

      Suppose you are looking to generate some email leads. Suppose you are looking for people who are searching for a vacuum cleaner. It so happens that you are selling one right now and would like to contact these people. With the use of this software you would be able to scrape craigslists, gumtree and other classified sites to get email addresses of people looking for a vacuum cleaner. Best of all, these addresses are public, these people want to be contacted and you are not doing anything spammy. Thats basically the whole idea behind it.

      What will make this program unique from other scrapers?? I will probably introduce the ability to teach it new methods of scraping. Basically, it will probably come preconfigured and ready to be used on many platforms but you could also "teach" it some new stuff (like country specific platforms and so on). I would also like to make it ultra-targeted and very specific. We'll see about that though.

      Cheers
      {{ DiscussionBoard.errors[2906180].message }}
  • Profile picture of the author iw433
    I think it would be great. Us marketers can always use a good piece of software to save time and hair.
    Signature

    Bill Skywalker Edwards
    Address-O-Lite

    {{ DiscussionBoard.errors[2908941].message }}
    • Profile picture of the author Luke Bishop
      Could you please incorporate 'True Local Australia' into your software?

      Thanks
      {{ DiscussionBoard.errors[3808052].message }}
  • Profile picture of the author osnetwork
    I would be very interested in your software as I am currently working manually with Yellow pages and I have looked at other software but they do not harvest email addresses. Will your software be able to get emails that are listed on the websites of the companies...
    Can you pm me to let me know if it is currently available and it's price..
    {{ DiscussionBoard.errors[5764296].message }}
  • Profile picture of the author AussieT
    I would be interested also in one that scrapes Aussie Directories.

    Provided it is kept up to date. Many of these scrapers stop working when the site changes its layout.
    {{ DiscussionBoard.errors[5764821].message }}
  • Profile picture of the author jtchaschowy
    Look into Imacros, it's very useful for scraping.

    Bit of a learning curve, you'll have to make your own bots and such but the code isn't difficult to learn in the slightest and best of all it's free, though there is a more advanced version which costs money but I have never needed any of it's functionality.

    I can rightfully say this software has helped me save hours of manual scraping wether it was from google places data, google keyword data, competitor scraping, etc etc.


    EDIT: I didn't realize this thread was resurrected from the dead.
    {{ DiscussionBoard.errors[7399349].message }}

Trending Topics