6 replies
  • WEB DESIGN
  • |
Google is not Indexing my Inner Pages of PHPBB. It is regularly Crawling and Indexing my Main Page but inner pages are not gettin crawlled ??


Please Reply soon what mite be the Problem. Robots or Anything else ??
#crawl #errors
  • Profile picture of the author mgreener
    Hi,

    Are your inner pages member only (password protected)? If not, do you have an xml sitemap listing every page on your site? You can also submit your xml sitemap to Google Webmaster Tools which will also alert you to any crawl errors.
    {{ DiscussionBoard.errors[4966473].message }}
  • Profile picture of the author Microsys
    Have you made sure to disallow crawling of duplicate URLs? (to save google robot resources for crawling your important pages, i.e. topics)

    a sitemap only including your important URLs could help as well
    {{ DiscussionBoard.errors[4971481].message }}
    • Profile picture of the author fr3quenzy
      Originally Posted by Sitemapper View Post

      Have you made sure to disallow crawling of duplicate URLs? (to save google robot resources for crawling your important pages, i.e. topics)

      a sitemap only including your important URLs could help as well
      I dont know much about what you are saying it would be greatfull if you would just check my robots.txt file and suggest if there is some problem in it i am giving you link below !

      http://forums.themeego.com/robots.txt
      Signature

      Get Personal Loan at best interest rate!

      {{ DiscussionBoard.errors[4984039].message }}
  • Profile picture of the author wowcolombia1
    Man im having a similar problem.with you type in the se site:Poker Game Online it appears one thing that i dont know what it is but it isnt a backlink and my site hasnt been indexed and i have waited 24 hours and builded alot of links
    {{ DiscussionBoard.errors[4984135].message }}
  • Profile picture of the author Microsys
    You have blocked profile pages which is good in my opinion. Maybe your forum just needs more incoming backlinks?
    {{ DiscussionBoard.errors[4984675].message }}
  • Profile picture of the author johnnyN
    have you got google webmaster tools installed for this website?
    if so then it will display any crawl errors that you have.

    your robots.txt file looks ok (except on a normal website you would allow /images - perhaps for a forum it may be different)

    I notice that you don't use permalinks, I am not sure if this affects googlebots, but perhaps it is having an effect.

    There could be some issues elsewhere, for example .htaccess file, or php scripts that are sniffing for robots and doing something else.

    google seems to only show me 35 pages indexed (do a search for site:forums.themeego.com ) , is that too low?
    {{ DiscussionBoard.errors[4985104].message }}

Trending Topics