7 Mistakes Most Beginners Make When A/B Testing

Jeanbaptiste Alarcon · 12th Apr 2016, 03:35 AM

Greetings CRO Warriors!

Coming at you today with an article on 7 mistakes beginners make when they start A/B Testing.

Why?

Because A/B Testing is becoming more and more popular. And while it promotes a data-driven decision making for both design and marketing, we see an alarming number of people getting imaginary / flawed results.

So we decided to do a series of articles on all the mistakes you could be making while A/B Testing.

You can read the first one on the beginner mistakes here (not limited to beginners, sometimes.

If you're of the impatient kind (like me), you can get the whole series as an ebook here: A/B Testing Mistakes | Conversion Matters

If you have any question, feedback or content request, hit me up here or on twitter @kameleoonrocks!

Cheers,
Jean-Baptiste

trobo · 12th Apr 2016, 12:22 PM

Very informative, and thanks for the share.

Another mistake beginners often make is changing more than one variable on a page in a single A/B test. It's important to only make one change per each test, that way you'll know for sure which one is responsible for the different results.

Mehdib · 12th Apr 2016, 02:55 PM

Nice article, but it is better to have the article here and then have a link at the end. to me it's just like rookie mistake to try to link an article this obvious and well the irony of 7 mistakes.

Jeanbaptiste Alarcon · 12th Apr 2016, 11:49 PM

@trobo Thank you! Yeah completely true, why would you test if you don't know what moved the needle

@mehdib Damn, I knew I did something wrong here. I guess I came here like I would on Linkedin groups. My bad.

I guess I should now write "The One Mistake Rookies Make When They Post On Warrior Forum for the First time".

Jokes aside, I should post the full article here (even if it's 2500 words long?) with a link at the bottom, or maybe a summary with the punchlines so you guys can judge if it's worth the click or nah?

Sorry again, I should've done my homework before posting.

Thanks for the advice

johnbrent606 · 26th May 2016, 12:36 AM

You share very informative article with us. Now we make sure that we can't repeat this mistake ever...

12th Apr 2016, 03:35 AM	#1
Jeanbaptiste Alarcon Warrior Member Join Date: 2016 Location: Paris, France Posts: 4 Thanks: 0 Thanked 1 Time in 1 Post	7 Mistakes Most Beginners Make When A/B Testing Share on: Greetings CRO Warriors! Coming at you today with an article on 7 mistakes beginners make when they start A/B Testing. Why? Because A/B Testing is becoming more and more popular. And while it promotes a data-driven decision making for both design and marketing, we see an alarming number of people getting imaginary / flawed results. So we decided to do a series of articles on all the mistakes you could be making while A/B Testing. You can read the first one on the beginner mistakes here (not limited to beginners, sometimes. If you're of the impatient kind (like me), you can get the whole series as an ebook here: A/B Testing Mistakes \| Conversion Matters If you have any question, feedback or content request, hit me up here or on twitter @kameleoonrocks! Cheers, Jean-Baptiste

12th Apr 2016, 12:22 PM	#2
trobo HyperActive Warrior Join Date: 2014 Posts: 137 Thanks: 8 Thanked 51 Times in 41 Posts	Re: 7 Mistakes Most Beginners Make When A/B Testing Share on: Very informative, and thanks for the share. Another mistake beginners often make is changing more than one variable on a page in a single A/B test. It's important to only make one change per each test, that way you'll know for sure which one is responsible for the different results.

12th Apr 2016, 02:55 PM	#3
Mehdib Digital marketer Join Date: 2015 Location: Christchurch, New Zealand Posts: 92 Thanks: 8 Thanked 16 Times in 16 Posts	Re: 7 Mistakes Most Beginners Make When A/B Testing Share on: Nice article, but it is better to have the article here and then have a link at the end. to me it's just like rookie mistake to try to link an article this obvious and well the irony of 7 mistakes.
	Marketing dude in technology world Works as digital marketing manager at ID printers

12th Apr 2016, 11:49 PM	#4
Jeanbaptiste Alarcon Warrior Member Join Date: 2016 Location: Paris, France Posts: 4 Thanks: 0 Thanked 1 Time in 1 Post	Re: 7 Mistakes Most Beginners Make When A/B Testing Share on: @trobo Thank you! Yeah completely true, why would you test if you don't know what moved the needle @mehdib Damn, I knew I did something wrong here. I guess I came here like I would on Linkedin groups. My bad. I guess I should now write "The One Mistake Rookies Make When They Post On Warrior Forum for the First time". Jokes aside, I should post the full article here (even if it's 2500 words long?) with a link at the bottom, or maybe a summary with the punchlines so you guys can judge if it's worth the click or nah? Sorry again, I should've done my homework before posting. Thanks for the advice
	Last edited on 12th Apr 2016 at 11:49 PM. Reason: typo

26th May 2016, 12:36 AM	#5
johnbrent606 HyperActive Warrior Join Date: 2016 Posts: 160 Thanks: 0 Thanked 24 Times in 24 Posts	Re: 7 Mistakes Most Beginners Make When A/B Testing Share on: You share very informative article with us. Now we make sure that we can't repeat this mistake ever...