How to crawl a website & build a product feed?

by willyboy104 2 replies
I've generally outsourced this activity for most of my clients however I am researching in to building product feeds for use with Google Shopping myself however I am wondering how do I go about crawling a site to get all the appropriate data, such as:

Product URL
Image URL
Product Description


I could obviously do this manually, but when a client has in excess of 5,000 products it is not feasible.

Anyone got any advice?

Thank you!
#search engine optimization #build #crawl #feed #product #website
Avatar of Unregistered
  • Profile picture of the author willyboy104
    Thanks, but no thanks - for the pointless, blatant promotion of your own services/lead generation in your site links.

    If you want to learn how to make money online, no bullshit click here.
    {{ DiscussionBoard.errors[7772483].message }}
  • Profile picture of the author Sillysoft
    I built something like this a long time ago. It was a php spider that would spider a site, get the product information and put it into an xml file then auto submit to places like froogle.

    What site are you trying to obtain these products? I wouldnt mind seeing if I could get my old script to try and grab those products.
    {{ DiscussionBoard.errors[7772849].message }}
Avatar of Unregistered

Trending Topics

  • 7 {{ upvoteCount | shortNum }}
  • 5 {{ upvoteCount | shortNum }}

    What's the best digital marketing certificate out there?

    I want to be an internet marketing specialist. You know like for social media and SEO I am not talking about those who you have to complete a whole program ... [read more]

  • 9 {{ upvoteCount | shortNum }}

    Im newbie.. i want a good strategy about getting money from net .. thx all

    Im newbie.. i want a good strategy about getting money from net . so if u know something about that just message me and i'll be so thankful .. sry ... [read more]

  • 32 {{ upvoteCount | shortNum }}

    How I get more click or traffic on particular keyword?

    Nikhil Bansal in SEO

    I have some keyword that has a great ranking on Google. but they don't have click and traffic on that keyword so I want to know how I get more ... [read more]

  • 4 {{ upvoteCount | shortNum }}

    Best strategy for the registration of a PBN's domains (to avoid being penalized)

    Herb Nazhe in SEO

    Hi I am about to create a Private Blog Network, and I need some advice about the best strategy to register its domain names. In particular, I need to know: ... [read more]