How to extract URLs from a site (without bringing the server down!)
One of my clients is migrating to a new ecommerce platform, and we need to get a list of urls from the existing site to start mapping out the 301 redirects. Usually, I'd use a tool like Xenu or Integrity to crawl and output a list.
However, the database and server setup is so bad that it can't handle the requests from these tools and it sends the site down. This, unsurprisingly, is one of the reasons for the migration.
Does anybody know of a way to get a full list of urls without having to make a bunch of http requests which will kill the site? Any advice would be much appreciated!
-
kashem -
Thanks
SignatureNiche Masterly - Get Revenue Generating Keywords For Your Niche Site.{{ DiscussionBoard.errors[5025041].message }} -
-
wasabi20 -
Thanks
{{ DiscussionBoard.errors[5025534].message }} -