Multisite Robots

by Louis Raven

Posted: 11 years ago 4 replies

WEB DESIGN

Hi all, I have a website example.com, an SMF forum example.com/forum, and a WordPress blog example.com/blog.

I'm not sure how to deal with sitemaps.xml and robots.txt, it seems each one (main, blog, forum) auto generates it's own version.

Will they play nice together or will the main robot/sitemap cancel each other out?

Would love to hear your views and suggestions.

#multisite #robots

Fantastic 11 years ago

I wouldn't imagine that they'd cancel each other out...

But I also don't see any real benefit to it other.

Don't quote on me on that though.

We'll see what others have to say.
- Thanks
{{ DiscussionBoard.errors[8602681].message }}
Louis Raven 11 years ago

Well I think I'll have to add a custom robots.txt for all sites. But still wondering about the sitemaps as I don't fancy adding links for every blog post or forum topic?
- Thanks
- 1 reply
Signature
Business Website Hosting
Car Detailing Network
How to Start a Mobile Detailing Valeting Business
Website Hosting Domain Marketing Templates Themes Logo
Detailing Discounts Valeting Directory
Detailing Forum Business Valeting Community
{{ DiscussionBoard.errors[8602708].message }}
- RobinInTexas 11 years ago
  
  The robots.txt MUST be in the domain root to comply with the specification for it. Create one manually and disable the autogeneration in the blog and the forum.
  
  Create a sitemap.xml in the root of the domain manually and add links to the example.com/forum/sitemap.xml and example.com/blog/sitemap.xml files.
  
  Thanks
  
  1 reply
  
  Signature
  
  Robin
  
  ...Even if you're on the right track, you'll get run over if you just set there.
  
  {{ DiscussionBoard.errors[8603718].message }}
  
  Louis Raven 11 years ago
  
  Originally Posted by RobinInTexas
  
  Create a sitemap.xml in the root of the domain manually and add links to the example.com/forum/sitemap.xml and example.com/blog/sitemap.xml files.
  
  So it's cool to have 3 different sitemaps? Hopefully Google doesn't favour the root one.
  
  Thanks
  
  Thanks
  
  Signature
  Business Website Hosting
  Car Detailing Network
  How to Start a Mobile Detailing Valeting Business
  Website Hosting Domain Marketing Templates Themes Logo
  Detailing Discounts Valeting Directory
  Detailing Forum Business Valeting Community
  
  {{ DiscussionBoard.errors[8603970].message }}

Multisite Robots

Trending Topics

kicking diet coke...

How can I start and where? Cold emailing is forbidden in GERMANY, since GDPR, which paid networking

Hello!

December Google Update

What's the most important lesson you've learned in affiliate marketing?