SEO, Need Your Expert Advice (Get a Thank You, Help Me Crack This)

[ildarius]

Got a web-site that's made of over 4,000 pages, content on these pages is super easy to rank for (names of small cities and States in the U.S), but not sure how to go about indexing all of them in Google.

Apart from sitemap + pinging do you have any other suggestions?

Thank you so much

[ildarius]

Guess it IS hard

[eseller]

get one PR5 link to your site and it will be enough for the indexing

[dburk]

Hi ildarius,

If your internal linking is done properly, all you need is one link from a page that is spidered regularly by googlebots. Googlebot will eventually crawl your entire website and consider your content for inclusion in their index.

If you haven't already done so you should definitely create an account at Google's Webmaster Tools to verify that there are no issues that are preventing your site from being crawled.

If your content is original and unique you will most like get it into Google's index. If you have a lot of competition you will need to promote targeted traffic to your pages and build your backlinks up to appear high enough in the index to be found.

As always, content is King and targeted traffic is Supreme.

[ildarius]

Thank you, already got it verified with Webmastertool, but from my calculations it's going to be months before it gets fully crawled...

[dburk]

Hi ildarius,

Get more links, two or three for each and every page on your site. This takes work but the payoff can be tremendous if your content is worthwhile.

You can use social bookmarks for fast crawling results, just take care not to abuse the networks or they will turn on you. Be a good contributor that doesn't just bookmark your own web pages.

You can do article marketing, you can setup blogs. squidoo and hub pages. You can add individual pages or sections of your website to directories.

The key is to do what is called deep linking, don't get links only to your home page. The more of this deep linking you have, the faster your site will be crawled and indexed.

[Nathan Navachi]

Something that I do sometimes to get higher rankings for a keyword of my choosing is go out and find 3-18 articles on my niche topic and find a free css template and create a new site that I call a 'link site' that is made for the sole purpose of driving traffic to my 'money site.'

This can be done in a couple hours, and you can put maybe 5-6 links in each article to each different page and use targeted anchor text for the exact term you want to rank for.

What's great about this is, say your site is about traveling in America in different cities (maybe?), you could create a site about something unrelated like cars and then in your article about Hondas where you have one line that says "this car is so reliable it will get you from cleveland to san francisco" you can link just those two words.

Thats what I would maybe do, search reprint articles and skim through them to see if there are any words that match what you want to rank for and then link to your own pages.

[ildarius]

This is great advice and I'll apply it for my regular sites, but I'm talking about getting a very large amount of pages indexed very quickly by G'gle (meaning I want it to crawl all of the pages)

The main page does not have to rank for any particular keyword

[-Nick-]

Get some deep links.

If possible get some script or get it coded so that the interlinking can take place.

Thanks.

[scene4u]

Try to make you have plenty of internal links so they Google can scan all the pages of your site when it visits. Remember, Google visits your site for just milliseconds so it needs to be able to find your pages quickly.

[maestero2010]

submit your website to some ranked directories(not all) , links submition to through articles, submting website to forums ...........but also try to get link exchanges with your competitor ..........google also did'nt like wat you also dont want to do...........this way you will might get indexed within 24 hours......

[protected]

Target some Business Orientated Keywords and submit your site to top most directory Sites.. and Make some good quality links depending on Most Prominent Keywords.... Make a proper keyword density in your site.... I hope this will really affect your business.

[yaji]

Social bookmarking and networking is the best way. Get all those pages bookmarked in all sorts of SB sites like digg and SNS sites like myspace/facebook . G will index your site pretty quickly.

[CTABUK]

Follow DBurks advice and you simply cannot go far wrong. It is a question of linking, not the index time, that will be milliseconds if your internal sitemap allows free and easy access.

Linking 4,000 pages though, well that is a long job. Each page is a landing page, each should have its own longtailed url with html, xhtml or php coding. Social bookmarking will not make the slightest difference unless the anchor text link is based on the pages keywords. The only way to do it is the long and laborious task of directory linking with the landing page being targetted at the keywords. There are no shortcuts.
Maybe video could help, I'll think about that.

[Bruce Hearder]

There a couple of ways of getting a largish site like yours indexed.

This is what I wouold do :

1.Make a valid Google sitemap of your site.. BUT keep the number of entries in the sitemap to less than 1000 (I aways go for 500 entries), make multiple sitemaps, with a sitemap index linking all sitemaps together.. NOTE: This is Goggoel XML sitemaps, not webpages with links to all your pages on them.. 2 different things

2. Put the sitemap index into your robots.txt file .. You do have one, don't you?
Not having one does slow down spidering of your site "big time"


2a. Make sure the site has an RSS feed coing out of it. If not, make one manually with your pages in it..
Then go to my.yahoo.com and put your feed into it.

3. Go to some of the major ping sites like Pingler.com, PinGoat.com and ping the first couple of pages of your site.
This will get the search engines over to your site within a minute or so.. Especially Yahoo becuase of the My.Yahoo link (Sneaky old trick that still works great)

4. Now go and setup a cron job on your server that will ping a different page of your website every odd hour or so.
Eg : At 1am it pings page1.html
At 3am it pings page2.html
and so on and on

Might need some PHP and or Javascript code to do this..

5. Once all of the above is up and running, then spend some time getting some links to your site. I would suggest a new article about your site every second day for 10-12 days (I like using EzineArticles as their site must be spidered a million times a day), and you will get a lot of search engines (SEs) running all over your site.

6. Spend some time doing SBM, especially on high ranking PR pages on DIGG.. This really works

7. Wash , Rinse and Repeat..

Your site will get indexed pretty quickly, but not overnight. You will find that the SEs will stop spidering your site after a certain number of pages (seems to be different for each site). Once you find that your number of indexed pages has plateaued (think thats how you spell it ), then do some more link building, this time linking to the pages that have not been linked and away you go again..

I hope this helps

Take care

Bruce

[IowaGal]

Originally Posted by ildarius

This is great advice and I'll apply it for my regular sites, but I'm talking about getting a very large amount of pages indexed very quickly by G'gle (meaning I want it to crawl all of the pages)

The main page does not have to rank for any particular keyword

First off I would be sure that your sitemap contains no more than 100 links per page. If it does, break that sitemap apart into several smaller pages and THEN submit it to Google.

Apart from that, and getting some links to your site, there is no other way to get your pages indexed that quick.

Not only is 4,000+ pages going to send up red flags to Google, but if it's a new site, you'll likely be sandboxed as well; that means that all of your pages won't show for quite some time in Google.

Typically getting a few links from high PR sites helps get you out of the sandbox (if in fact you're in one).

I would suggest for future sites that instead of waiting to get 4,000 pages indexed overnight, to work on the pages one by one, and get those incoming links built up to those individual pages.

Curious - 4,000 pages sounds a little questionable to me. If the only difference between the pages are city and state names does this mean that each page consists of the same exact content aside from those two factors?


- Kristine

[bshearer]

I agree with Bruce and IowaGal but with an edge.

It is difficult to feel a ceiling or a barrior in regards to "Too Fast".

I believe what you want and what is possible can be attained safely. It will take some creative thinking.

1. The Pinging has to be regulated.
2. Socializing can make a small dent but it is consuming.
3. RSS feeds also have to used but since the site is already built the slow growth factor is lost.

I think it is going to take a blended approach. A divide and conquer plan.

Questions
Do you have a Blog network at your disposal?
Are your 1,000 pages siloed in any way?

Here is what I would do.

Let's say they are siloed and each silo has 250 pages.

1. Ensure that you have cross linking from silo to silo. Just really good on-page optimization
2. Have a RSS feed for each Silo
3. Each Silo should have its own Sitemap and Sitemap.xml
4. Outsource or Write yourself 4 primary articles for each silo.
5. Outsource or re-Write each of those 4 articles an additional 4 times each.
6. Submit the all of the original articles which would be 20 articles to ezine and once approved move to the next step.
7. Prepare a spinable file for each silo.
8. Map out your text links so that you can make those spinable too to as to spread out a blanket effect for the entire site. I would build groupings of 10
9. Take each spinable file and process with a Blog Network once then switch our your next grouping of links and then spin those.

This will produce a blanket of most of the pages. One the spidering starts on these pages it will spread and eventually cover the missing pages from the Blog network.

And as always. Thats my opinion.

In fact, I am preping a site right now to test the ceiling in indexing.

Good Luck!

[Bruce Hearder]

Some good suggestions here..

A combination of everything above should get your site moving

Take care

Bruce