Fetch as google on multilingual domain

1 replies
  • SEO
  • |
I have multilingual website under different subdirectories com/en, com/fr etc. When i use crawl this url and its direct links does it crawl all languages/subdirectories or not?
#domain #fetch #google #multilingual
  • Profile picture of the author Sclark
    This may depend on your interlinking, sitemap, robots.txt or any other specific tags on the pages that may restrict them from indexing. You may try WebsiteAuditor to check that - I use the tool once I need to have a look at a website with Google`s eyes, as it can crawl and analyze any website as on behalf of any specific bot following your robots instructions respectively. (If I`m not mistaken, there is Googlebot on default list of bots at once).
    {{ DiscussionBoard.errors[10959239].message }}

Trending Topics