How to scrape and automate markup for supplier not offering feeds/api

by xInd
5 replies
  • ECOMMERCE
  • |
I would like to have a script like a wordpress plugin running to pull descriptions, pricing & apply % markup, images and specs from a supplier of mine of hardware / electronics / computers. They don't have feeds or an api to do this with so would need to maybe scrape the site manually. The site in question, the supplier, is NCIX.com - Canada's Premier Computer Store - Online PC Discount Store, Buy Computer Accessories.
Any suggestions?
#automate #feeds or api #markup #offering #scrape #supplier
  • Profile picture of the author vick2011
    Hi,

    Use PHP, CURL, Regex or Simple HTML DOM.
    {{ DiscussionBoard.errors[7892253].message }}
    • Profile picture of the author aduer
      Look into iMacros. You can build macros to scrape data from websites.
      {{ DiscussionBoard.errors[7894307].message }}
  • Profile picture of the author alksense
    Originally Posted by xInd View Post

    I would like to have a script like a wordpress plugin running to pull descriptions, pricing & apply % markup, images and specs from a supplier of mine of hardware / electronics / computers. They don't have feeds or an api to do this with so would need to maybe scrape the site manually. The site in question, the supplier, is NCIX.com - Canada's Premier Computer Store - Online PC Discount Store, Buy Computer Accessories.
    Any suggestions?
    There are a ton of guys on freelancer.com that would probably do this for $40 or so. I would recommend posting this a project there... they have an entire section dedicated to scraping.
    {{ DiscussionBoard.errors[7896475].message }}
  • Profile picture of the author seanster
    Custom Scraping can be a real hassle, especially if their page keeps changing, and you can't get a hold of your developer you hired 3 months ago! Happens a lot on these elance sites. Definately choose someone you can go back to.
    Signature
    Snaplitics, Inc. - The Newest & Easiest Website & Landing Page Builder
    SnapPlayer - Users can SNAP to Key Points in your Video
    TheJumpStarter - Catchy, Brandable Domain Names!

    {{ DiscussionBoard.errors[7905513].message }}
  • Profile picture of the author ZackAllen
    check out the page source. they use a lot of (almost %100) inline styling. so, scraping it is very hard. I can say it will cost you more than you think.
    {{ DiscussionBoard.errors[7907081].message }}

Trending Topics