Tsarina

Help!
We have 200K+ pages website and no decent sitemap. I have programmers that can make it for me, if I tell what I need. The problem is I have no clue what I need. Any one can help?
A bit about site: Site is 100% 'homemade", has directory with 4-page listings of each compony, articles, local pages (all counties and cities), calendar, etc.

webtrix

Have you tried looking at similar sites as your own? Check out their sitemaps..

Anyway, go to Creating and submitting Sitemaps - Webmasters/Site owners Help
Find this Create a Sitemap > General guidelines for URLs in SitemapsSee more:

• SitemapGenerators - sitemap-generators - A collection of links to tools and code snippets that generate Sitemap files. - Project Hosting on Google Code

• sitemaps.org - Protocol

Tsarina

Thanks webtrix, will check them out. Any ideas on custom written sitemap scripts? DO they make sense at all?

Steve Wells

Try this out......... its a site map auto script that automatically makes a site map for you. http://www.qualitydigitaldownloads.c...Cat=Web Master

Ken Durham

Are you talking about an XML sitemap for the searches or one for your visitors?
If for Google I believe the maximum amount of urls per site map is 50,000 so you have to break it up into multiple pages and use a sitemap index like this: http://www.homecomputergames.com/sitemapindex.xml
Don't click the products sitemaps because you will get 50,000 listing on your page.

Most of the scripts I have seen out there will time out because of PHP memory issues.
So you may have to set your allocated memory accordingly.

I scripted my generator myself which pulls all information from the DB and generates the index and various other sitemaps.

If you mean a sitemap for your visitors you will want to watch how many items per page you show them as you may crash some browsers. So I would keep the sitemap for the visitors to just categories and non product pages if possible.

Webmaster Services
List Your Wealth Building Systems and Services for Free

Insanity is doing the same thing over and over and expecting a different result ~ Einstein
Insanity is doing the same thing over and over and never getting the same results ~ Ken

jimbo999

I've just completed a sitemap for a site with 140,000+ pages. Basically, I've done exactly what was suggested by HomeComputerGames, except I also use the priority and lastmod tags. It is a database site that is split into states, so my sitemap.xml links to state.xml's.

I can almost guarantee that an automated product will fail horribly when trying to create a sitemap for 200K pages.

Jeff Poulton

I couldn't agree more with jimbo999. With this many pages, your best bet is to build a customized solution. I have done this for clients in the past and it's much easier to maintain and verify.

If there are logical ways to separate the pages into groups, I would use this as a natural way to segregate your xml files for the search engines.

"The sky's the limit, but don't underestimate the opposing power of gravity on your rocket ship."

Rocketmade.com - Professional Website Videos (for landing pages, squeeze pages, etc.)

Tsarina

Thank you, EWGQDD, HomeComputerGames , jimbo999 , Jeff Poulton.

HomeComputerGames, I was wondering is it possible to see the script you write for yourself?

Alex Nash

As CharismaticV said. Try google for "Free sitemap maker" or "Sitemap Generator" and you will find something:-).


Regards,
A.N