How do SE spiders crawl dynamic pages?

1 replies
  • SEO
  • |
If I have a single page that has 500 different versions based on results returned from a SQL query how does a spider crawl each of those page variations? I need to be certain each of the 500 variations are indexed regularly
#crawl #dynamic #pages #spiders
  • Profile picture of the author Michael Nguyen
    Originally Posted by webpeon View Post

    If I have a single page that has 500 different versions based on results returned from a SQL query how does a spider crawl each of those page variations? I need to be certain each of the 500 variations are indexed regularly
    Google will crawl the page but with 500 variation which in my opinion is not unique enough, you'll end up having the majority of it in the supplementary index. It's a catch 22. If you must have 500 indexed, use canonical urls
    Signature
    {{ DiscussionBoard.errors[6708095].message }}

Trending Topics