Using different %'s of traffic

allanminium · 31st Jul 2014, 05:50 PM

I've been running a few tests using varying % levels of traffic and each time I seem to get slightly different results. The first two times I ran it, I used 10% of total traffic; the first test got no significance, the second time got a decrease in conversion rate with significance, and the third time I ran it with 100% of traffic and got an increase in conversion rate with significance.

All 3 tests sway in varying directions. Has anyone encountered this experience? And how do you make a call on something like this?

SEO Power · 11th Aug 2014, 03:02 PM

I guess you need to redo the tests with the same percentages of traffic to see if you will get the same conversation rates again.

lerozk · 11th Aug 2014, 04:01 PM

Much more than percentage of traffic matters homogeneity of traffic. Have you used the same traffic sources during all of the three tests?

MelanieandMiles · 11th Aug 2014, 04:50 PM

What are the sample sizes here?

When you say 10% of total traffic, did this total 1000 unique visits?

You really need to run 1000 visits to an A/B test before having data you can rely on, long term... And, depending on your audience size, your niche and a few other factors, you could potentially bump into the law of diminishing returns.

31st Jul 2014, 05:50 PM	#1
allanminium Warrior Member Join Date: 2012 Posts: 5 Thanks: 1 Thanked 0 Times in 0 Posts	Using different %'s of traffic Share on: I've been running a few tests using varying % levels of traffic and each time I seem to get slightly different results. The first two times I ran it, I used 10% of total traffic; the first test got no significance, the second time got a decrease in conversion rate with significance, and the third time I ran it with 100% of traffic and got an increase in conversion rate with significance. All 3 tests sway in varying directions. Has anyone encountered this experience? And how do you make a call on something like this?

11th Aug 2014, 03:02 PM	#2
SEO Power Senior Warrior Member Join Date: 2014 Location: Houston, TX Posts: 1,616 Thanks: 16 Thanked 248 Times in 230 Posts	Re: Using different %'s of traffic Share on: I guess you need to redo the tests with the same percentages of traffic to see if you will get the same conversation rates again.
	ONE HOUR INDEXING - STOP WASTING MONEY ON LINKS GOOGLE NEVER FINDS

11th Aug 2014, 04:01 PM	#3
lerozk Warrior Member Registered Member Join Date: 2013 Posts: 11 Thanks: 0 Thanked 1 Time in 1 Post	Re: Using different %'s of traffic Share on: Much more than percentage of traffic matters homogeneity of traffic. Have you used the same traffic sources during all of the three tests?

11th Aug 2014, 04:50 PM	#4
MelanieandMiles Lifestyle Warriors Join Date: 2009 Location: Surf-Heaven, Mexico Posts: 447 Thanks: 149 Thanked 206 Times in 123 Posts	Re: Using different %'s of traffic Share on: What are the sample sizes here? When you say 10% of total traffic, did this total 1000 unique visits? You really need to run 1000 visits to an A/B test before having data you can rely on, long term... And, depending on your audience size, your niche and a few other factors, you could potentially bump into the law of diminishing returns.
	Free How-To Videos On Everything From Sales Funnels, Facebook PPC & More! https://www.YouTube.com/milesb