Earn $1000 a Month from Scraping Data

23 replies
If you had a tool to scrape ANY data you wanted from ANY website, what type of business would you setup? What would you do with it? How would you make money?

I know that the possibilities are endless, but trying to get some great feedback from experienced warriors here.

What would you do to get to quickly get to $1000 per month?
#data #earn #month #scraping
  • Profile picture of the author E. Brian Rose
    Whatever I did to make the money, I would set it aside for attorney fees, because if you steal content from other websites, you will surely end up needing a good one.
    Signature

    Founder of JVZoo. All around good guy :)

    {{ DiscussionBoard.errors[6605517].message }}
    • Profile picture of the author dc53123
      Not true AT ALL.... some of the largest companies in the world scrape data constantly to re-purpose it for many things.

      Maybe do a little research...
      {{ DiscussionBoard.errors[6605525].message }}
      • Profile picture of the author E. Brian Rose
        Originally Posted by dc53123 View Post

        Not true AT ALL.... some of the largest companies in the world scrape data constantly to re-purpose it for many things.

        Maybe do a little research...
        Whether it's true or not really depends on what you are scraping. If you scrape copyrighted content, you will find yourself in a world of hurt. If you are scraping telephone numbers to build a small business database, that is another story. Perhaps you could elaborate a bit more on the type of content you will be scraping.
        Signature

        Founder of JVZoo. All around good guy :)

        {{ DiscussionBoard.errors[6605535].message }}
        • Profile picture of the author dc53123
          Yes, exactly... it depends on what you are scraping and what you are doing with the info. I'm not saying to get arrested and do something illegal. I'm looking for clever people, with clever ideas to see what some people can come up with.

          There are thousands of ideas for building something with this model.

          Just to name a few...


          1. Gather leads from online business directories
          2. Discover product defects by scraping product reviews on message boards and forums.
          3. Gather foreclosure listings by zip code, and stay up-to-date on foreclosed properties.
          4. Identify private sellers from auto and property websites.
          5. Gather search engine rankings.
          6. Gather classified ads from many different sites.
          7. Extract job board listings from private companies and large job boards.
          8. Monitor news sites for keywords.
          9. Gather company information from many different directory websites.
          10. Gather product catalogs including images and product manuals from wholesalers/manufacturers websites.
          11. Monitor order status from ecommerce portals. See what orders you still need to fulfill, when they were ordered, and all applicable details.
          12. Extract top selling information for products on auction websites.
          13. Monitor competitor's inventory information.
          14. Extract textbook prices (new/used) from top college textbook e-retailers.
          15. Verify that distributors are selling products in accordance with contracts (right price, right condition, right quantity).
          16. Gather contact information for homes that were recently purchased.
          17. Gather medical directories of specialists in every state.
          18. Gather political press releases from candidates.
          19. Gather bookings for any type of resort, or area.
          20. Gather user reviews for any product or service.
          21. Gather financial information from any financial website.
          22. Gather weekly ads from competitor grocery stores.
          23. Monitor blogs for new postings.
          24. Gather domain name arbitration decisions and commentary.
          25. Gather volcanic activity information.
          26. Gather historical weather information.
          27. Gather the chemical makeup of compounds from science sites.
          28. Check the meta information on pages of a website (description, keywords, page title).
          29. Extract element/source code of web pages. Including, but not limited to HTML, JavaScript.
          30. Capture search engine local rank for businesses.
          31. Capture search engine ad page rank.
          32. Monitor commodity prices.
          33. Extract information from corporate financial statements.
          34. Extract profile information from popular social media websites.
          35. Gathering auto part compatibility information (which part goes with which cars).
          36. Extract useful information from encyclopedia and journal websites.
          37. Extract tourist attraction information.
          38. Extract dealer inventory information.
          39. Extract top book and movie sales rank from leading ecommerce websites.
          40. Automate the process of background checks on individuals.
          41. Gather and create industry directories.
          42. Create RSS feeds for specific keywords on various websites.
          43. Extract bond and stock pricing history.
          44. Gather restaurant reviews from major review sites.
          45. Gather historical case results from federal law websites.
          46. Create a national directory of attorneys.
          47. Monitor interest rates for competitor banks and publish data as an RSS Feed.
          48. Create an event aggregator websites (concerts, sporting events, etc.).
          49. Extract ticket availability from major ticket websites.
          50. Extract product images and specification documents.
          {{ DiscussionBoard.errors[6605573].message }}
          • Profile picture of the author Tom Burlingham
            Sounds like you have a good start without us
            {{ DiscussionBoard.errors[6606111].message }}
          • Profile picture of the author Joe Mobley
            Your list has given me a couple of ideas.

            Something for you to consider.

            ifttt.com

            Google alerts "ifttt"

            Twitter - follow - @ifttt

            If you are not familiar with ifttt then prepare for your thinking to be expanded.

            Good luck.

            Joe Mobley



            Originally Posted by dc53123 View Post

            Yes, exactly... it depends on what you are scraping and what you are doing with the info. I'm not saying to get arrested and do something illegal. I'm looking for clever people, with clever ideas to see what some people can come up with.

            There are thousands of ideas for building something with this model.

            Just to name a few...


            1. Gather leads from online business directories
            2. Discover product defects by scraping product reviews on message boards and forums.
            3. Gather foreclosure listings by zip code, and stay up-to-date on foreclosed properties.
            4. Identify private sellers from auto and property websites.
            5. Gather search engine rankings.
            6. Gather classified ads from many different sites.
            7. Extract job board listings from private companies and large job boards.
            8. Monitor news sites for keywords.
            9. Gather company information from many different directory websites.
            10. Gather product catalogs including images and product manuals from wholesalers/manufacturers websites.
            11. Monitor order status from ecommerce portals. See what orders you still need to fulfill, when they were ordered, and all applicable details.
            12. Extract top selling information for products on auction websites.
            13. Monitor competitor's inventory information.
            14. Extract textbook prices (new/used) from top college textbook e-retailers.
            15. Verify that distributors are selling products in accordance with contracts (right price, right condition, right quantity).
            16. Gather contact information for homes that were recently purchased.
            17. Gather medical directories of specialists in every state.
            18. Gather political press releases from candidates.
            19. Gather bookings for any type of resort, or area.
            20. Gather user reviews for any product or service.
            21. Gather financial information from any financial website.
            22. Gather weekly ads from competitor grocery stores.
            23. Monitor blogs for new postings.
            24. Gather domain name arbitration decisions and commentary.
            25. Gather volcanic activity information.
            26. Gather historical weather information.
            27. Gather the chemical makeup of compounds from science sites.
            28. Check the meta information on pages of a website (description, keywords, page title).
            29. Extract element/source code of web pages. Including, but not limited to HTML, JavaScript.
            30. Capture search engine local rank for businesses.
            31. Capture search engine ad page rank.
            32. Monitor commodity prices.
            33. Extract information from corporate financial statements.
            34. Extract profile information from popular social media websites.
            35. Gathering auto part compatibility information (which part goes with which cars).
            36. Extract useful information from encyclopedia and journal websites.
            37. Extract tourist attraction information.
            38. Extract dealer inventory information.
            39. Extract top book and movie sales rank from leading ecommerce websites.
            40. Automate the process of background checks on individuals.
            41. Gather and create industry directories.
            42. Create RSS feeds for specific keywords on various websites.
            43. Extract bond and stock pricing history.
            44. Gather restaurant reviews from major review sites.
            45. Gather historical case results from federal law websites.
            46. Create a national directory of attorneys.
            47. Monitor interest rates for competitor banks and publish data as an RSS Feed.
            48. Create an event aggregator websites (concerts, sporting events, etc.).
            49. Extract ticket availability from major ticket websites.
            50. Extract product images and specification documents.
            Signature

            .

            Follow Me on Twitter: @daVinciJoe
            {{ DiscussionBoard.errors[6606677].message }}
            • Profile picture of the author dc53123
              @ Joe - The ifttt tool is AMAZING and incredibly powerful. thanks for sharing! WOw, this thing could go far. Do you know of any ways others are making money using this tool??
              {{ DiscussionBoard.errors[6612516].message }}
              • Profile picture of the author Joe Mobley
                Yes, I'll tell more later. :rolleyes:

                Oh, and sorry if I hijacked the thread.

                Joe Mobley


                Originally Posted by dc53123 View Post

                @ Joe - The ifttt tool is AMAZING and incredibly powerful. thanks for sharing! WOw, this thing could go far. Do you know of any ways others are making money using this tool??
                Signature

                .

                Follow Me on Twitter: @daVinciJoe
                {{ DiscussionBoard.errors[6617991].message }}
                • OP: If you're going to lift content (especially keyword-rich lists) from other sites, please attribute it or some of us might think poorly of you.

                  The list was taken from:

                  Web Scraping and Data Extraction with iMacros

                  Looks like our OP is considering buying the product...

                  fLufF
                  --
                  Signature
                  Fiverr is looking for freelance writers for its blog. Details here.
                  Love microjobs? Work when you want and get paid in cash the same day!
                  {{ DiscussionBoard.errors[6618814].message }}
                  • Profile picture of the author joseph7384
                    [DELETED]
                    {{ DiscussionBoard.errors[6620144].message }}
                    • Profile picture of the author Joe Mobley
                      For you scrapper-programmer types (and you know who you are) let me recommend that you download and read at least the first 10 pages.

                      16.8 Million Dollar Autopilot Solution From Greece

                      Joe Mobley
                      Signature

                      .

                      Follow Me on Twitter: @daVinciJoe
                      {{ DiscussionBoard.errors[6628290].message }}
                      • Profile picture of the author capitalalchemy
                        I personally don't see this as making people's lives easier, but more chaotic. It's technology chasing after technology chasing after technology, etc.

                        I know a lot of people are still "all about it", but a lot of people are starting to ask "why? what's the point?".

                        But I'm a radical in these parts. I questioned Pinterest after all :rolleyes:
                        {{ DiscussionBoard.errors[6628380].message }}
            • Profile picture of the author sbucciarel
              Banned
              Originally Posted by Joe Mobley View Post

              Your list has given me a couple of ideas.

              Something for you to consider.

              ifttt.com

              Google alerts "ifttt"

              Twitter - follow - @ifttt

              If you are not familiar with ifttt then prepare for your thinking to be expanded.

              Good luck.

              Joe Mobley

              Now that's different. Thanks for the link.
              {{ DiscussionBoard.errors[6613250].message }}
            • Profile picture of the author Riich
              Truly amazing! Thank you for sharing.


              Originally Posted by Joe Mobley View Post

              Your list has given me a couple of ideas.

              Something for you to consider.

              ifttt.com

              Google alerts "ifttt"

              Twitter - follow - @ifttt

              If you are not familiar with ifttt then prepare for your thinking to be expanded.

              Good luck.

              Joe Mobley
              {{ DiscussionBoard.errors[6616556].message }}
      • Profile picture of the author kindsvater
        Originally Posted by dc53123 View Post

        some of the largest companies in the world scrape data constantly to re-purpose it for many things.
        Google
        Microsoft

        .
        {{ DiscussionBoard.errors[6605562].message }}
  • Profile picture of the author lotsofsnow
    This is turning into an interesting thread!
    Signature

    Call Center Fuel - High Volume Data
    Delivering the highest quality leads in virtually all consumer verticals.

    {{ DiscussionBoard.errors[6613458].message }}
  • Profile picture of the author Gambino
    I'd use to to scrap the feeds that I'm currently paying about 3k for each year.
    {{ DiscussionBoard.errors[6613668].message }}
  • Profile picture of the author marketwarrior06
    Banned
    I think telling / advertising about your job product and what can you do with that tool is a good idea to increase your earning. if you get notified by others then you will start earning within a few month. all about marketing.
    {{ DiscussionBoard.errors[6616575].message }}
  • Profile picture of the author Matinee
    Haven't used it myself but had a browse around https://scraperwiki.com/ a few weeks ago. Might be of interest...
    {{ DiscussionBoard.errors[6616592].message }}
  • Profile picture of the author pdrs
    lol i wish people would keep ifttt under their hats
    Signature
    RemoteControlHelicopterReviews.(com/net) - Up for sale! No reasonable offer refused. Great branding for a super hot niche!
    {{ DiscussionBoard.errors[6617401].message }}
    • Profile picture of the author sbucciarel
      Banned
      Originally Posted by pdrs View Post

      lol i wish people would keep ifttt under their hats
      Too late. ifttt is out of the bag now
      {{ DiscussionBoard.errors[6617499].message }}
      • Profile picture of the author Joe Mobley
        Re: ifttt

        I created a separate gmail account for my ifttt activities.
        Use filters to quickly separate different topics (recipes).
        Setup Google alerts for "ifttt".
        Follow ifttt.com on Twitter.

        This is not a lot different from the above post but managing all of your ifttt activities into 1 email account makes this a very quick and easy followup.

        I will open a Google Chrome browser and login to the email account that I setup for ifttt. Leave it minimized and can check it every now and then with just a click or two. I use Firefox for most of my I'net activities so I'm not having to log in and out of different gmail accounts.

        ... And I only scratch the surface of ifttt.

        Joe Mobley
        Signature

        .

        Follow Me on Twitter: @daVinciJoe
        {{ DiscussionBoard.errors[6617866].message }}
  • {{ DiscussionBoard.errors[6619537].message }}

Trending Topics