Cloudflare and Internet Archive Partnership is Great for Publishers

by WarriorForum.com Administrator
1 replies
A new article on Search Engine Journal says that Cloudflare and the Internet Archive have announced a new partnership aimed at providing benefit for web publishers everywhere. You may know the Internet Archive better as the Wayback Machine. Even if you don't use Cloudflare, you may still gain an advantage from the team-up.



Why's that? Well, It's not just Cloudflare benefiting from the partnership. It means the Internet Archive also gets access to more data, and that's going to be good for everyone ultimately. The Wayback Machine is a non-profit that exists to keep snapshots of the disappearing internet, and that's a huge resource for publishers once pages have gotten removed from the web. The Wayback Machine has been around since 1996 and holds more than two decades' worth of web page history. That archive contains a staggering 330 billion web pages.

Cloudflare is a security and content delivery network that helps websites speed up delivery of web pages and to mitigate the effects of distributed denial-of-service (DDoS ) attacks. The company hosts clients' static content on servers situated all over the world, and visitors get to view content on a server that's geographically nearby. Dynamic content still gets retrieved from the server that originally hosted it. Cloudfare's 'Always Online' feature is where this partnership got off the ground. Crawlers tour websites up to seven days a week and download copies of content and pages to form a cache of material that's always available for users - in case technical issues mean the website temporarily goes offline. The Wayback Machine now gets a copy as soon as a website gets crawled, saving resources when dealing with Cloudflare customer sites. Cloudshare gets the benefit of having access to the archive if a site goes down.

"The Internet Archive's Wayback Machine has an impressive infrastructure that can archive the web at scale," said Matthew Prince, co-founder and CEO of Cloudflare. "By working together, we can take another step toward making the Internet more resilient by stopping server issues for our customers and in turn from interrupting businesses and users online. An additional source of URLs we will preserve now originates from customers of Cloudflare's Always Online service. As new URLs are added to sites that use that service they are submitted for archiving to the Wayback Machine. In some cases this will be the first time a URL will be seen by our system and result in a "First Archive" event. In all cases those archived URLs will be available to anyone who uses the Wayback Machine."
>Publishers everywhere benefit in the case of dispute about where content originated. They also get to recover deleted material they wish to republish. So, don't worry - if you get hacked, and you don't have a back-up, you've always got the Wayback Machine!
#archive #cloudflare #great #internet #partnership #publishers
Avatar of Unregistered
  • Profile picture of the author Matthew Stanley
    Cool! Wayback Machine is one of my favorite things online. Been following Cloudfare since its IPO - very impressive company & happy to see them do this. The more archiving the better
    {{ DiscussionBoard.errors[11623038].message }}

Trending Topics