Go Back   WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum
Register Blogs FAQ Social Groups CalendarHelp Desk

Reply
 
LinkBack Thread Tools
Old 01-19-2009, 02:03 AM   #1
HyperActive Warrior
 
Join Date: Jan 2009
Location: Witney, UK
Posts: 449
Thanks: 48
Thanked 22 Times in 14 Posts
Default Get crawled every few days

Hi guys,

I have a page on my site that I want to get crawled every few days or as much as possible. The reason for this is that it is a page that shows items/pages that have been recently added to my website, so I want to do it to get these new pages indexed as I shell be adding a few each and every day.

The page in question is;

Most Recent

Any help or tips on how to do this would be fantastic.
burtie is offline   Reply With Quote
Old 01-19-2009, 02:40 AM   #2
Active Warrior
 
Join Date: Jan 2009
Posts: 36
Thanks: 0
Thanked 5 Times in 5 Posts
Default Re: Get crawled every few days

Add frequent new content, google decides how often it crawls your site, i beleive it's possible to put a comment in the header tag, to give google's spiders a request to visit more often, also if you add a sitemap, you can stipulate that your content changes daily.

alby is offline   Reply With Quote
Old 01-19-2009, 02:43 AM   #3
Senior Warrior Member
War Room Member
 
Steve Crooks's Avatar
 
Join Date: Jan 2006
Location: Hampshire, United Kingdom.
Posts: 1,568
Thanks: 72
Thanked 377 Times in 194 Posts
Social Networking View Member's Twitter Profile 
Default Re: Get crawled every few days

Open a webmaster tools account with google, submit a google sitemap and you get options available about spider activity. Also make sure you have a robots file on your server to instruct search engine bots where they can and can't go.

Quote:
Originally Posted by burtie View Post
Hi guys,

I have a page on my site that I want to get crawled every few days or as much as possible. The reason for this is that it is a page that shows items/pages that have been recently added to my website, so I want to do it to get these new pages indexed as I shell be adding a few each and every day.

The page in question is;

Most Recent

Any help or tips on how to do this would be fantastic.

Check Out My New Challenge
The Google Free Website Profits Challenge!

--------------------------

Steve Crooks is offline   Reply With Quote
Old 01-19-2009, 03:21 AM   #4
HyperActive Warrior
 
Join Date: Jan 2009
Location: Witney, UK
Posts: 449
Thanks: 48
Thanked 22 Times in 14 Posts
Default Re: Get crawled every few days

Cheers guys. Working on your suggestions now.
burtie is offline   Reply With Quote
Old 01-19-2009, 03:45 AM   #5
Advanced Warrior
War Room Member
 
Bruce Hearder's Avatar
 
Join Date: May 2004
Location: Perth, Australia.
Posts: 717
Thanks: 4
Thanked 185 Times in 138 Posts
Social Networking View Member's Twitter Profile  View Member's YouTube Profile
Contact Info
Send a message via Skype™ to Bruce Hearder
Default Re: Get crawled every few days

Doing a couple of manual pings to the page won't do any harm either..

Go to places like :
Ping-o-Matic!
www.pingoat.com and
Blog and Ping Tool - Use Pingler.com to Drive Traffic your Blogs and Websites

will soon get the bots racing over to your site..

Hope this helps

Bruce
Bruce Hearder is offline   Reply With Quote
Old 01-19-2009, 03:53 AM   #6
HyperActive Warrior
 
Join Date: Jan 2009
Location: Witney, UK
Posts: 449
Thanks: 48
Thanked 22 Times in 14 Posts
Default Re: Get crawled every few days

Quote:
Originally Posted by Bruce Hearder View Post
Doing a couple of manual pings to the page won't do any harm either..

Go to places like :
Ping-o-Matic!
www.pingoat.com and
Blog and Ping Tool - Use Pingler.com to Drive Traffic your Blogs and Websites

will soon get the bots racing over to your site..

Hope this helps

Bruce
All pinged (except for the middle one that is down for maintenance).
burtie is offline   Reply With Quote
Old 01-19-2009, 04:00 AM   #7
Advanced Warrior
War Room Member
 
Bruce Hearder's Avatar
 
Join Date: May 2004
Location: Perth, Australia.
Posts: 717
Thanks: 4
Thanked 185 Times in 138 Posts
Social Networking View Member's Twitter Profile  View Member's YouTube Profile
Contact Info
Send a message via Skype™ to Bruce Hearder
Default Re: Get crawled every few days

Yeah PinGoat.com has been down for a few days now..
Not quite sure what is happening there..

I have found that once you ping a site with Pingler, GoogleBot can be on the site with 60seconds (thats right, seconds)

Pingomatic sometimes works, bit most of the time it never gets the BOTS to turn up..

Hope this helps..

Bruce
Bruce Hearder is offline   Reply With Quote
Old 01-19-2009, 04:13 AM   #8
Warrior Member
 
Join Date: Jan 2009
Location: London
Posts: 23
Thanks: 1
Thanked 0 Times in 0 Posts
Social Networking View Member's Twitter Profile 
Default Re: Get crawled every few days

I've been using pingler but noticed that the captcha text is always 'wrong' the first time round, not that it actually is. Is their a reason for that? I always check about three times to make sure I've put in the right text but it never works, I always have to fill in another one before it accepts it.

Deedah is offline   Reply With Quote
Old 01-19-2009, 04:22 AM   #9
HyperActive Warrior
 
Join Date: Jan 2009
Location: Witney, UK
Posts: 449
Thanks: 48
Thanked 22 Times in 14 Posts
Default Re: Get crawled every few days

Quote:
Originally Posted by Bruce Hearder View Post
Yeah PinGoat.com has been down for a few days now..
Not quite sure what is happening there..

I have found that once you ping a site with Pingler, GoogleBot can be on the site with 60seconds (thats right, seconds)

Pingomatic sometimes works, bit most of the time it never gets the BOTS to turn up..

Hope this helps..

Bruce
Well, looking forward to its visits.
burtie is offline   Reply With Quote
Old 01-19-2009, 04:59 AM   #10
Advanced Warrior
War Room Member
 
Bruce Hearder's Avatar
 
Join Date: May 2004
Location: Perth, Australia.
Posts: 717
Thanks: 4
Thanked 185 Times in 138 Posts
Social Networking View Member's Twitter Profile  View Member's YouTube Profile
Contact Info
Send a message via Skype™ to Bruce Hearder
Default Re: Get crawled every few days

Quote:
Originally Posted by Deedah View Post
I've been using pingler but noticed that the captcha text is always 'wrong' the first time round, not that it actually is.
I've noticed the same thing..

Maybe its their attempt to reduce the amount of spam pings (whats the new name for that.. SPLINGS)

Anyway once you get it right, its seems to work fine after that..

Take care

Bruce
Bruce Hearder is offline   Reply With Quote
Old 01-19-2009, 10:45 AM   #11
SeOnErD
 
Join Date: Oct 2008
Location: Phoenix
Posts: 36
Thanks: 1
Thanked 1 Time in 1 Post
Social Networking View Member's Twitter Profile  View Member's YouTube Profile
Default Re: Get crawled every few days

I can get a page crawled in hours if I create a Press Release about the page on PRLOG and link to it from my press release.

luckycharmz336 is offline   Reply With Quote
Old 01-19-2009, 10:48 AM   #12
HyperActive Warrior
 
Join Date: Jan 2009
Location: Witney, UK
Posts: 449
Thanks: 48
Thanked 22 Times in 14 Posts
Default Re: Get crawled every few days

Quote:
Originally Posted by luckycharmz336 View Post
I can get a page crawled in hours if I create a Press Release about the page on PRLOG and link to it from my press release.
Interesting,

I will bear that in mind.
burtie is offline   Reply With Quote
Old 01-19-2009, 10:55 PM   #13
Warrior Member
 
Join Date: Jan 2009
Posts: 12
Thanks: 0
Thanked 0 Times in 0 Posts
Default Re: Get crawled every few days

build your inlinks for fast indexing.

makepurple is offline   Reply With Quote
Old 01-20-2009, 12:42 AM   #14
HyperActive Warrior
 
Join Date: Jan 2009
Location: Witney, UK
Posts: 449
Thanks: 48
Thanked 22 Times in 14 Posts
Default Re: Get crawled every few days

Quote:
Originally Posted by berryhill View Post
I have learnt a lot here,thanks guys.
Another way to get your site indexed is to write quality article and post it in a high traffic forum and then put a link that will link back to your site in the article you wrote.
Yeah I am going to start article marketing for the site soon.

Does anybody know the quantity of quality links that I should be aiming for? 1000+? 10000+?

Any ideas?
burtie is offline   Reply With Quote
Old 01-22-2009, 06:42 AM   #15
HyperActive Warrior
War Room Member
 
maestero2010's Avatar
 
Join Date: Dec 2008
Location: LK
Posts: 492
Blog Entries: 1
Thanks: 84
Thanked 20 Times in 20 Posts
Social Networking View Member's Myspace Profile  View Member's FaceBook Profile  View Member's Twitter Profile  View Member's YouTube Profile
Contact Info
Send a message via Skype™ to maestero2010
Default Re: Get crawled every few days

webmaster account with google helps you to choose the crawlers activity on your website.........

Praveen - SR-Project Manager
Extreme Seo Internet Solution - Certified Search Engine Optimization Company
Seo Forum | Seo Company | Shared Hosting| Entrepreneurship Forum
maestero2010 is offline   Reply With Quote
Reply

  WarriorForum - Internet Marketing Forums > The Warrior Forum > Adsense / PPC / SEO Discussion Forum

Tags
crawled, days

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -6. The time now is 03:14 PM.