Reply {{ subscribed ? 'Subscribed' : 'Subscribe' }} Subscribed Subscribe
LinkBack Thread Tools Search this Thread
Unread 22nd Feb 2013, 04:37 AM   #1
Advanced Warrior
War Room Member
 
willyboy104's Avatar
 
Join Date: 2009
Location: London, UK
Posts: 931
Thanks: 332
Thanked 135 Times in 64 Posts
Default
How to crawl a website & build a product feed?
Share on: 
fb share twitter share gplus share more share

I've generally outsourced this activity for most of my clients however I am researching in to building product feeds for use with Google Shopping myself however I am wondering how do I go about crawling a site to get all the appropriate data, such as:

Product URL
Image URL
Product Description
Price
Brand

e.t.c

I could obviously do this manually, but when a client has in excess of 5,000 products it is not feasible.

Anyone got any advice?

Thank you!

Looking for a PPC Professional - I can help.
*Paid Media Expert*
*Manage International Brands - American Express, Nespresso, Game Group, Boots & More*
PM or Add me to Skype, and let's discuss!

skype: willyboy104
willyboy104 is offline   Reply With Quote
Unread 22nd Feb 2013, 06:32 AM   #2
Advanced Warrior
War Room Member
 
willyboy104's Avatar
 
Join Date: 2009
Location: London, UK
Posts: 931
Thanks: 332
Thanked 135 Times in 64 Posts
Default
Re: How to crawl a website & build a product feed?
Share on: 
fb share twitter share gplus share more share

Thanks, but no thanks - for the pointless, blatant promotion of your own services/lead generation in your site links.

-_-

Looking for a PPC Professional - I can help.
*Paid Media Expert*
*Manage International Brands - American Express, Nespresso, Game Group, Boots & More*
PM or Add me to Skype, and let's discuss!

skype: willyboy104
willyboy104 is offline   Reply With Quote
Unread 22nd Feb 2013, 08:17 AM   #3
SumoCoder
 
Join Date: 2012
Posts: 595
Thanks: 15
Thanked 71 Times in 67 Posts
Default
Re: How to crawl a website & build a product feed?
Share on: 
fb share twitter share gplus share more share

I built something like this a long time ago. It was a php spider that would spider a site, get the product information and put it into an xml file then auto submit to places like froogle.

What site are you trying to obtain these products? I wouldnt mind seeing if I could get my old script to try and grab those products.

No more...
Sillysoft is offline   Reply With Quote
Reply

  Warrior Forum - The #1 Internet Marketing Forum & Marketplace Search Engine Optimization

Bookmarks

Tags
build, crawl, feed, product, website

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off




All times are GMT -6. The time now is 02:33 PM.