Duplicate content in 'White Label Shop' sub domain. How do I avoid a Google penalty?

[Martin N Smith]

Hi all,

I'd really appreciate some input on this one.

We're about to partner with a well known price comparison site in the UK: beatthatquote.com (recently acquired by Google).

BeatThatQuote will be providing a 'white label' insurance site that'll be linked from our main website. The white label will be branded with our logo, headers & footers. The idea here is to create a seemless transition from the vistor landing on our website to entering the white label shop.

Here's my question.

Most affiliates of BeatThatQuote create a sub-domain where the white label shop is located.

For example, assuming my website is called GreatDealsOnline.com, the white label shop would be hosted on:

Shop.GreatDealsOnline.com

The problem I have with this is that BeatThatQuote run these white label websites for 1,000s of affiliates in the UK, and the content within the white label shop is EXACTLY the same on each site.

So, when Google indexes Shop.GreatDealsOnline.com and finds the same content that's already been posted elsewhere online (hundreds of times over) , I'm assuming it'll penalise the main site GreatDealsOnline.com accordingly.

Assuming this is the case, I guess I'll need to BLOCK the Google bot from crawling the sub domain (with 100% duplicate content) but how exactly do I do this?


Can someone please tell me exactly what I need to include on the robots.txt file on both the main site and the sub domain to ensure this is setup correctly?

If there's a best practice approach to this i'd be keen to know. Ideally, although I want to block the search bots from crawling the sub domain - with 100% duplicate content - I still want Google to know that users are effectively still 'on site' so the bounce rate for the website as a whole (main site and sub domain) remains low.

Any thoughts, advice would be gratefully appreciated

Cheers
Martin

[freeflyer]

shop.greatdealsonlinecom will be classsed as a seperate site than greatdealsonline.com. Providing that your main site has unqiue content it will not be affected by the subdomain.
Ergo, you do not need to block shop.greatdealsonline.com from the search engines.

Also, remember there is no penalty, there is a filter. Ie you will never incur a penalty for having duplicate content. Google will just not list it... but you wont incur a black mark.

[AnilK]

I have had a white label site for over 2 years and have not had a problem in getting pages ranked and getting traffic through google. And I have left the google bot to crawl whereever it wishes

[Martin N Smith]

Originally Posted by AnilK

I have had a white label site for over 2 years and have not had a problem in getting pages ranked and getting traffic through google. And I have left the google bot to crawl whereever it wishes

Are you trying to rank the white label or the main domain though? I'm concerned that Google will slap the main domain because of duplicate content in the sub domain (white label).

[freeflyer]

you needn't worry.. it wont.

[Martin N Smith]

okay cool - thanks

[Pushkartyagi]

Dear Martin,

I really appreciate the way you have explored your Query regarding this
"White Label Issue". Friend i m also Going through this Same Problem.
I would be very thankful to you if you can share with me your Experience regarding using robot.txt for the sub domain.

• Is that worked for you..??
• Are you Getting your Site Ranked on Google
• Does White Label is really Bad for S.E.O

I Hope you will Pay Attention to my Request & will Surely help me out in this with your Kind Suggestions..



thanks,
Pushkar Tyagi
Pushkar.tradeindia(@)gmail.com