How do I get google to crawl my site?

[locpic63]

Google hasn't crawled my site in over 90 days. Is there a way to get them to do this?

[handyman]

Submit your sitemap to google webmaster tools, submit an article with a link to your site to article directories, post a question on yahoo answers and then answer that question (with a different a/c obviously) with a link to your website, use a service like pingler to inform google that you are there, tweet a link to your site.... there are 1000 more ways to get it crawled within few hours...

[HCLee]

You can revisit your website structure as it affects your crawl rate.The less people have to click to find what they want, the better it is. The same concept applies to the search engines crawlers.

[pbennett]

are you talking about the google bot that returns SERPs or are you talking about that other crawler?

I'm having the same problem, but it's with the crawler. I can't get an answer about it, either. Adsense says I have a blocked URL. Hostgator says that they aren't blocking anything and that they need the IP address of the crawler to check it out. I can't get any answers...

[Stephen Meyer]

The fastest way to get Google and the other search engines to find your site is to subit it to Social sites. Google and the rest never leave most active social sites because of the constant new content being aded by the minute. A link on one will point Google in your direction very quickly.

[Matt Helphrey]

You have a meta tag code on your page that is asking the google bot to come every 30 days. I would just get rid of it or change it to 7 days. Heres the code Im talking about...

<meta name="Revisit-after" content="30 days"><meta name="Rating" content="GENERAL">

Matt

[Patrician]

I will tell you a little secret - this forum gets indexed within minutes! A guy in the off-topic forum ran some tests and it was like 20 minutes. (obscure keywords)

So don't ever think you're wasting your time hanging out here!

[locpic63]

Thanks Matt

That was a great help! I don't see how I missed that.

Thanks
Locpic63

[HomeBizNizz]

Yeah, Google loves fresh content.
Blogs are a SE magnet.

[Jack Chua]

Submit your site. Provide links to google sites like blogger. You can also provide links to directory sites. It would be a sure ball.

[ggoddi]

For the answer, I think Googel has more say than anyone, so just check Webmasters/Site owners Help

I am sure u will find answer here. Hope help!

[GT]

Originally Posted by Patrician

I will tell you a little secret - this forum gets indexed within minutes! A guy in the off-topic forum ran some tests and it was like 20 minutes. (obscure keywords)

So don't ever think you're wasting your time hanging out here!

Hi, Patricia:

So true. For example, I use the WF blog regularly and it definitely gets indexed within a short period of time - sometimes just minutes.

I post to my Web Bizz Blog first, then I post to the WF blog, then I check the post title key words and both blogs are usually on the first page within the hour (or half hour ... or twenty minutes ... lol ... I guess I haven't actually timed it.)

GT

[Andariels]

Hello. Its one week now. I have my website on godaddy. My page is not indexed and also not crawled. I have made some backlinks yesterday (cca 10 websites from angelas package). I also add sitemap.xml on google webmaster tool and set up google analytics. Its bigger problem there? Or do i must be more patient ?

[Andariels]

MY GOD. After my reply my page is indexed in minutes warrior forum is the bestbestbest

[nash2925]

From my experience, I can say that starting a blog in sub-domain with fresh and unique content will juice up your sites and also get some reasonable traffic. This will make Google spiders to crawl your site frequently.

<meta name="Revisit-after" content="30 days"><meta name="Rating" content="GENERAL">

Good observation

[allsuccess]

Here is the link which helps you submit your site to google. Just replace XXXX with your domain name and copy and paste it in the URL Tab of your browser.


http://www.google.com/webmasters/sit...om/sitemap.xml


Hope this helps.

[HomeBizNizz]

Use the Google Webmaster Tools:
www.google.com/webmasters/tools/

[mhedwebmaster]

Thank you so much for all the tips here. I will put them to good use.

Jenn

Pallet Rack, Used Pallet Rack, Used Shelving, New Pallet Racks

[Mattiyu]

Would Google's lack of crawling have anything to do with the new slap terms that has come out as of late August?






A Slimmer You

[idevelop]

Ive just added a new site today.. not quite finished, but this thread has been a great help in what and how I should get things started..

thanks.

[hubreality]

Thanks for sharing.

[BenjaminGates]

Getting crawled is the easiest thing to do. Submitting to google directly is not a good thing to do. My blog got indexed automatically, even when I did not submit its link anywhere else on the net and also not submitted to Google. I just enabled a setting in blogger to let search engines crawl the site. Of course it took few months for that. if I had submitted its link at a social bookmarking site it would have got indexed in minutes.

[diegom1975]

Guys this forum is very interesting and helpful. I'm just starting my website and google inner workings are a mystery to me, I submitted a map and followed almost all the advice for my photography site and nothing, I'm posting the link here to see it the magical effect people talk about works for me.

Photography by Diego A unique and creative photography studio in Miami.

I'll keep you posted. Thanks for all the great advice.

[nephelimnick]

Great forum, thanks for all the good advise and info! I shall put this into practise!


www.virtualhomme.com

[leesteve]

I have the same problem aswell owner i cant get google to crawl my pages, i have tried to paste the html into my pages but i cant see my html as im using yahoo site solution manager ans cant change my html. my site is www.diyanswerdirect.com im hoping it will be crawled from here as patrician said. i contacted yahoo and they come out with a load of rubbish about waiting and to see what happens lol help me some one please.

[Lian]

This is what I usually do with my new websites:

1. Go to feedagg.com and submit your RSS feed. Then, claim a lens.

2. Go to technorati.com and claim your blog using your keyword

3. Use Onlywire.com and submit your website to social networking sites. Take the time to confirm on each of them. (especially with digg.com, stumbleupon.com)

4. Get a Google analytics account and verify your website ownership

5. Upload your sitemap xml file.

6. Get a Google Webmasters account and submit your sitemap (http://www.Yourwebsite.com/sitemap.xml)

7. Complete your profile on your Google account and add your URLs

8. Submit your blog at Blogged - Blog Social Network & Blog Directory and Social Blogger Community & Blog Directory // BlogCatalog. Again using your keywords

9. Submit your feeds on feedburner.com (you can do this on your google account)

10. Write articles and submit them on ezinearticles.com

If you are using wordpress cms, also check if the privacy settings are done to allow the search engines to crawl your website.

My new websites normally gets indexed in one to three days time when I do these things.

Thanks,

Lian

[merchantman1]

No kidding. I am having a terrible time getting google to crawl my new site. I am using backlink text like this: Merchant Account Quote and still can't seem to get it to work. I registered my sitemap and everything. I just can't seem to get google to scan my site and it has been a month. Does anyone know a better way to get this done for free and quickly?

[tommen]

Visit a high traffic blog and leave a relevant blog comment.

[steved333]

Originally Posted by merchantman1

No kidding. I am having a terrible time getting google to crawl my new site. I am using backlink text like this: Merchant Account Quote and still can't seem to get it to work. I registered my sitemap and everything. I just can't seem to get google to scan my site and it has been a month. Does anyone know a better way to get this done for free and quickly?

I noticed that you don't have a signature here. Be sure to add your website to your signature in all the forums you use. This forum is fantastic for rankings because it's so huge and has been around for so long. Guaranteed you'll get indexed quickly from posting here.

Lian,

I would add just two things to what you suggested. Actually, there is one thing that you mentioned that I have not done, and thanks for that.
There is a program from Incansoft called RSSBot. It costs 25 bucks, and you can use that to submit your RSS feed from your blog (which you should add to your site without a doubt- blogs are best for SEO) automatically to a whole slew of feed aggregators, which will get you indexed within a few minutes. Every time you post or add a page or anything, use it to ping.

Also, if you use Onlywire or just the social bookmarking sites, many of them will give you a feed you can use. Add all of those feeds to the Bot and submit those and ping them whenever you bookmark a new page from your site. All this takes a grand total of about 5 minutes once it's all set up, and the link love you get is unbelievable.

[steved333]

Oh, one other thing. Blog Carnival - Blog Communities Publishing Magazines. Go there and submit your relevant posts to every blog directory out there on that site. Do that once a week to once a month depending on how often they let you (each one is different). That'll tack on about an extra hour or two per month, but hey. Link love, baby.

[richandrich]

This is great information. Anyone have suggestions about a Ning site using the same concepts. My alexa rating is going down, but I would love to get my page rank increased.

Desiree

[Cecille20]

Google is pretty good at crawling new content. And submit your article in article directories. Bookmarked your article in social sites. Submit your site in directory. Also, create a blog to your site.

[jinmin]

The simplest way to get Google crawl our site is to have link in other popular sites like article or directory site. make sure you have sitemap your site to make crawling process faster and easier for the bot.

I have use this technique for more than 3 years now and it works great !

[rbwilson]

I find that Wordpress.com blogs work wonders. They are free, easy to setup and get crawled frequently. If you can post to your Wordpress blog consistently then you can use it to point to your site.

Brian
Real Estate Market Information by Real Estate Professionals - Zolve
Zolve Referral Network
Zolve Real Estate Blogs
Woodlands, Cypress, Magnolia Homes for Sale - the Woodlands TX Real Estate

[andi_gt2005]

I get my sites indexed sometimes in less than an hours using: scribd.com and slideshare.net.

[tbrim20]

Great Thread. Can't wait to test this stuff out and see the results!

[tbrim20]

Half a day later and still nothing. I've been trying all the tricks without much success. Maybe I should give it a day or so.

[swoffice]

I am just testing whether Google crawls this site as quickly is people have posted. Office Just a test

[kirsten89]

Thanks for all the help! I've had my blog for a few months and it shows up on a yahoo search but not google! hopefully it will soon!!

www.maisondepeanutleigh.com

[Murano glass chandeliers]

So you think posting here will make my website be crawled in minutes?
I have to try that before I believe it.

Murano chandeliers

Thank you all.

[whitney01]

hello,

have you submitted your site to DMOZ? or other directories? if not you need to submit them so when your site was approved by them. the search engines can easily crawl your site.. then you can put backlinks so you can drive traffics and increase your page rank..

[Marcidius]

Hey, everyone else is testing this indexing theory, I figure I should too!

Optical

Also, Lian - thanks for the excellent checklist! I E-noted that puppy!

[Atomic83]

Thanks guys. I am going to try these.

[Stephen Meyer]

I've checked almost every site posted and haven't found any that have not been indexed by Google. Most seem to have very little content so Google will not come back very often. The more content you post on a regular basis and the more backlinks you get on a regular basis, preferably links from high PR sites, the more often Google will pay you a visit.

Remember that both Google and Alexa rank your site using several factors the largest factor is the number of visitors you have coming from unique links and unique searches along with links from relevant higher page rank sites. So, as you build your site and backlinks you will gain natural traffic and your sites rank will increase accordingly. How fast that happens depends on how much work you put into it.

[Matt Belock]

Here you can try this to get indexed. Also get some backlinks. I got a few off of this.

Where it says yourdomain, put your site there. Copy it and paste it into your browser and hit enter. Give it a couple minutes or hours and you should be fine.

http://www.statbrain.com/www.yourdomain.com

http://www.cubestat.com/www.yourdomain.com

I have a list of others iam playing with so we will see.

[rainspeak]

A slightly on subject question, no doubt this has been answered many times here. What is the general opinion preference between Hostgator vs Godaddy as far as user friendliness? I've not tried go Daddy yet but Hostgator can be complicated.

[Patrician]

rainspeak - you mean an entirely OFF topic question. What does hosting account comparison have to do with getting your site crawled by Google, which is the topic of this thread.

I know you are new here and just trying to help (so I won't delete your post) - in the future please just start a new topic for a different subject.

See the little black button that says 'New Thread' at the top left of this forum index? (not in this thread but when you are there with all the threads listed in the index)

[acgcoug]

Originally Posted by nephelimnick

Great forum, thanks for all the good advise and info! I shall put this into practise!


www.virtualhomme.com

my site is a work in progress, but I am going to try this as well.

www.deermountainpreserves.com

[bryanps]

Hi Guys, great topic here.

This is what I usually do with my new websites:

1. Go to feedagg.com and submit your RSS feed. Then, claim a lens.

2. Go to technorati.com and claim your blog using your keyword

3. Use Onlywire.com and submit your website to social networking sites. Take the time to confirm on each of them. (especially with digg.com, stumbleupon.com)

4. Get a Google analytics account and verify your website ownership

5. Upload your sitemap xml file.

6. Get a Google Webmasters account and submit your sitemap (http://www.Yourwebsite.com/sitemap.xml)

7. Complete your profile on your Google account and add your URLs

8. Submit your blog at Blogged - Blog Social Network & Blog Directory and Social Blogger Community & Blog Directory // BlogCatalog. Again using your keywords

9. Submit your feeds on feedburner.com (you can do this on your google account)

10. Write articles and submit them on ezinearticles.com

If you are using wordpress cms, also check if the privacy settings are done to allow the search engines to crawl your website.

My new websites normally gets indexed in one to three days time when I do these things.

Thanks,

Lian

Thanks Lian for sharing this info. I've already done some of the things on your list there.

Just to add a bit here.

I think one of the best ways to get your page ranks up is to build backlinks. Some of you might have already mentioned how to do this.

-submitting your site to article directories
-distributing articles
-commenting on blogs
-social bookmarking
-reciprocal or 3 way linking

Those of you who own PIPS should really read Day 12 and Day 13 on building backlinks. I highly recommend getting good quality backlinks from Angela and Paul's backlink builder.

[tawn31]

Originally Posted by bryanps

Hi Guys, great topic here.



Thanks Lian for sharing this info. I've already done some of the things on your list there.

Just to add a bit here.

I think one of the best ways to get your page ranks up is to build backlinks. Some of you might have already mentioned how to do this.

-submitting your site to article directories
-distributing articles
-commenting on blogs
-social bookmarking
-reciprocal or 3 way linking

Those of you who own PIPS should really read Day 12 and Day 13 on building backlinks. I highly recommend getting good quality backlinks from Angela and Paul's backlink builder.

I agree with you as I use Feedagg alot and I use a website called social poster which is connected to all the social networks. Its similar to onlywire. You can also ping your blog to get the google crawlers to your site. Use websites like pingomatic, pingoat, and sharkfeed. These should help you get the word out.