Do you have experience developing technology for content aggregators?

by 1 replies
1
I want to build a tool that collects and serves real time pricing information from a dozen or so different websites. In your experience, do I need to receive permission from the individual sites prior to serving the pricing information?

For example, the popular travel sites pull airfare prices from many different resources, rates advertised by other content aggregators and rates offered the airlines themselves. Is it possible that an aggregator like Cforce.com has agreements with other aggregators and airlines that allows them to serve pricing information?
#programming #aggregators #content #developing #experience #technology
  • Get permission and a proper feed from them, you will be much happier.

    It is possible to scrape the info, but it takes a lot of server power on your servers part to process and its real easy to break if they change anything on their website.

    A nice feed in some standardized format ( like XML ) will save you a lot of hassles later.

Next Topics on Trending Feed

  • 1

    I want to build a tool that collects and serves real time pricing information from a dozen or so different websites. In your experience, do I need to receive permission from the individual sites prior to serving the pricing information? For example, the popular travel sites pull airfare prices from many different resources, rates advertised by other content aggregators and rates offered the airlines themselves. Is it possible that an aggregator like Cforce.com has agreements with other aggregators and airlines that allows them to serve pricing information?