Is Google Not Doing Much Indexing/Crawling?

by momo3

Posted: 13 years ago 4 replies

Hey

I am a bit uneducated as far as google indexing / crawling.

Can a google bot crawl a site but not cache it/index it until a later date?

In other words, can Google see (and count) an outbound link on a site, but not "Cache" the page until many days later?

The reason I ask is -- I have a blog network that I mentioned is taking some time to really show its horsepower.

And I am kind of shocked by it.. and I am thinking that the links put on the network of sites have not been seen by G.

If I do a bulk cache check with Scrapebox and look over my network, I see most were seen at the beginning of this month.. (many links were not placed at this point)

I used to feel that G would index high PR sites within like 48 hours or so.

But perhaps they do and I am just not understanding indexing/caching/crawling.

Lastly, if I put my network into a backlink indexing service, would it be ok? I realize there is some risk to this but just wondering if I could do it slowly with a service.

#google #indexing or crawling

Curtis2011 13 years ago

Getting indexed is fast and easy.

Most new sites I put online are indexed within 48 hours.

All I do is create a sitemap with this and ping it with this.
- Thanks
- 1 reply
{{ DiscussionBoard.errors[8495665].message }}
- momo3 13 years ago
  
  UPDATE: I checked WMT and no new links have been found on my site this month (despite me dropping many on my PR network). I feel google is crawling and indexing slow lately. But correct me of i am wrong, I am a rookie with this.
  
  Thanks
  
  {{ DiscussionBoard.errors[8495677].message }}
WebMeUp 13 years ago

Originally Posted by momo3

I checked WMT and no new links have been found on my site this month

Originally Posted by momo3

Can a google bot crawl a site but not cache it/index it?

Yes, it can. If your new pages are hidden from indexation (e.g. with robots.txt files, robots meta tags, etc.), Google crawler won't include these pages into the index.

So, if you want Google to crawl and index these pages, make sure that there's nothing that restricts the search engine crawler from accessing them.

Originally Posted by momo3

can Google see (and count) an outbound link on a site, but not "Cache" the page until many days later?

Yes, that's possible.

Google may crawl your outbound links, index them but these links may appear in Google's cache a couple of days later (in very rare cases it may take longer than a week). That's quite a common thing and there's no way one can gear up this process at the moment.

However, you can speed up the process of indexing your new pages, thus reducing the total amount of time till the moment your pages appear in Google's cache.

These are the most popular ways to make Google index your site pages faster:

- creating a sitemap and uploading it to your site;
- submitting a sitemap to Google WebMaster Tools;
- bookmarking these pages on bookmarking sites;
- creating offsite content that contains links to your new pages, etc.

Hope you find this info useful.
- Thanks
Signature
WebMeUp Backlink Tool - the largest growing backlink index on the Web: http://webmeup.com/tools/backlinks.html
[HOT] WebMeUp solution for NOT PROVIDED: http://webmeup.com/not-provided.html
[NEW] WebMeUp Blog - the blog about the latest industry news and hottest trends: http://webmeup.com/blog/
{{ DiscussionBoard.errors[8501691].message }}
TrustedSEO 13 years ago

OP,

How has your indexation and blog network coming along? i'm sort of interested to hear back from you to see how everything is coming along?

If you need help, I'm Gregory Smith. Please ask me any questions that you might have and I'll do my best to answer them as quickly as possible.

Regards,
Gregory Smith
- Thanks
Signature
Visit My Reputable SEO Company -> Either Click here OR Here OR To Email me click here!! :)

A Top 20 Local SEO Blog: Check out our FREE SEO and Internet Marketing Tutorials! An awesome SEO Blog just for you!
{{ DiscussionBoard.errors[8515927].message }}