10 {{ upvoteCount | shortNum }}
10 {{ upvoteCount | shortNum }}

Scraping data and automated script

by Marko Kresic
9 replies
Does anybody here create script for scraping data and for what purpose?

Any idea what would be good for selling or any other type of monetizing?

So far I scrap website with adult content and create my site. Now when somebody upload video on site, it shows on my site. I added my ads to. Everything is fully automated. (If you want se example, I will send you trough personal message.)

I think scraping is good because you can use more time for advertising site.
#automated #data #scraping #script
  • Profile picture of the author WebProjectUK
    The only problem with data scraping is that some sites prohibit this i.e Amazon for example. Therefore, it's a little bit of grey area to working in. It would be interesting to see your thoughts on this?
    {{ DiscussionBoard.errors[11158745].message }}
  • Profile picture of the author Marko Kresic
    I heard something for Amazon but I didn't check. I think it depends on method what is used for scraping. Also, depending on method and what data you scrap, few changes on page can stop script.
    {{ DiscussionBoard.errors[11158758].message }}
  • Profile picture of the author jamie3000
    If you want to scrape the big players you'll need lots of rotating proxies and learn to use headerless browsers
    {{ DiscussionBoard.errors[11158780].message }}
    • Profile picture of the author anayb
      Originally Posted by jamie3000 View Post

      If you want to scrape the big players you'll need lots of rotating proxies and learn to use headerless browsers
      PhantomJS headless browser works for me!
      Signature
      Do you need an exclusive video product?
      Graphics Design - Motion Graphics - 2D & 3D Animation - Video Editing - Color Grading - Logo Animation - etc
      {{ DiscussionBoard.errors[11158847].message }}
  • Profile picture of the author Marko Kresic
    So far I used PHP and his simple html dom. It grabs HTML code from URL and read it. I don't think you can hide HTML code.
    {{ DiscussionBoard.errors[11158843].message }}
  • Profile picture of the author Regional Warrior
    Originally Posted by Marko Kresic View Post

    Does anybody here create script for scraping data and for what purpose?

    Any idea what would be good for selling or any other type of monetizing?

    So far I scrap website with adult content and create my site. Now when somebody upload video on site, it shows on my site. I added my ads to. Everything is fully automated. (If you want se example, I will send you trough personal message.)

    I think scraping is good because you can use more time for advertising site.

    Thread repoted for self-promotion
    {{ DiscussionBoard.errors[11158848].message }}
  • Profile picture of the author ChrisBa
    Scraping can be good depending on what purpose you're using it for.

    If you can find a use for it for yourself then you can likely sell it to someone who wants to use it for the same thing
    Signature
    {{ DiscussionBoard.errors[11158900].message }}
    • Profile picture of the author Marko Kresic
      My problem is I don't know what should I scrap.
      {{ DiscussionBoard.errors[11159321].message }}
  • Profile picture of the author Marko Kresic
    I'm asking admin to edit my post to be not self-promotion.
    {{ DiscussionBoard.errors[11159319].message }}

Trending Topics