Scraping price from affiliate product page into wordpress.

6 replies
If you were to set up a price comparison page for a few similar shops that offer affiliate programs.

Is there a way to scrape the data from each product page source code and have it update to your wordpress page or post automatically?
#affiliate #page #price #product #scraping #wordpress
  • Profile picture of the author Paz
    I use this chap's scraping library/functions for php;
    » PHP Screen Scraping BRADINO

    I'm new to the forum and don't know everyone yet - how much more detail would you need

    Cheers,
    Paz.
    {{ DiscussionBoard.errors[7668565].message }}
  • Profile picture of the author Adam Struve
    It would be possible, but there isn't any ready-made plugin or anything available that I'm aware of.

    You'd have to code the scraping instructions for each site you want to get the price from. Then let it know what Wordpress post ID it needs to import it into. You would have to have maybe a div or a span with an id name that the script can find to know where to import the price.
    {{ DiscussionBoard.errors[7669844].message }}
  • RSS would probably be your best option. Or
    we can just build you a scraper for this capability.

    WILL-
    Signature
    WebDevelopmentGroup NYC & CA- Small Business Web Development, App Development, WordPress Development, Graphic Designs, Online Marketing, Local Marketing & more!. "Call us 1.800.219.1314 or message us!". Visit us today! "Now On Live Chat Mon-Fri.". www.WebDevelopmentGroup.org
    (Whitelable our Services)
    ===================================
    ==> #1 OFFLINE MARKETING FORUM ON THE WEB! <==
    www.OFFLINEMARKETINGFORUM.com
    (Register Now)
    {{ DiscussionBoard.errors[7670049].message }}
  • Profile picture of the author Lovelogic
    For those first fledgeling steps in Web Scraping take a look at Yahoo Pipes, this will create an RSS feed that WordPress understands and was designed for non-programmers with a drag & drop interface.
    {{ DiscussionBoard.errors[7673573].message }}
  • Profile picture of the author Rbtmarshall
    Thanks for pointing me in the right direction. I tried searching around for scraping, but once I used the terms php page scrape as mentioned above, I found the area I needed to be looking into.

    The Sites I am trying to get info from don't have any data feeds, but that yahoo pipes interface looks pretty neat. It seems like it would be good for scraping targeted news for your site.


    I'm non-programmer, but I might spend a little time to try and learn php, it looks like it can do allot of things I might find useful for marketing.
    {{ DiscussionBoard.errors[7675178].message }}
    • Profile picture of the author kevintb7
      I believe usually it is called "screen scraping" or "screen scalping" if that helps in your search. I would think that doing this when the client loads the page would slow load times quite a bit. You might be better off setting up a server side job that runs every hour (not sure how often the data you're looking for changes) and updates a database. Then simply call that info back from the database when the page loads. I've developed plenty of these but in the windows environment (not in php )
      {{ DiscussionBoard.errors[7697155].message }}

Trending Topics