How to crawl a website & build a product feed? I've generally outsourced this activity for most of my clients however I am researching in to building product feeds for use with Google Shopping myself however I am wondering how do I go about crawling a site to get all the appropriate data, such as: Product URL Image URL Product Description Price Brand e.t.c I could obviously do this manually, but when a client has in excess of 5,000 products it is not feasible. Anyone got any advice? Thank you! |
Re: How to crawl a website & build a product feed? Thanks, but no thanks - for the pointless, blatant promotion of your own services/lead generation in your site links. -_- |
Re: How to crawl a website & build a product feed? I built something like this a long time ago. It was a php spider that would spider a site, get the product information and put it into an xml file then auto submit to places like froogle. What site are you trying to obtain these products? I wouldnt mind seeing if I could get my old script to try and grab those products. |
All times are GMT -6. The time now is 11:55 PM. |