Quick, Efficient Split Testing Guide For Businesses

10 replies
You've probably heard it before... split testing is everything. If you can bump conversion even by 1%-5%, you can increase your net profits by several thousands of dollars.

Yet, most people don't do it.

And it blows my mind, because it's FUN as hell (and makes you a ton of money)

This is what I'm doing, it's dead simple, and I'll include the exact numbers so this will be kind of a 'case study' at the same time. I'm doing this for Hyperhour, which is a kick ass time tracking solution (and they have accepted to let me share their numbers)

Step 1.

Any way you cut it, you need a tool to split test. Results don't magically come out of thin air. I personally signed up for Optimizely because... well... they are f'ing badass and super simple to use.

But...

You can also use Google A/B testing as well (which is free, but it requires you to compile entirely new pages)

And I know there are a bunch of php scripts that will help you split test. But trust me, the simplest option I've found so far is optimizely.

Step 2.
Start with easy, yet significant changes.

For instance, right now I'm starting with the headline... and ONLY the headline. You'd be amazed if you saw how MUCH of an impact a simple headline can have. (And you'll see by the results.... it really DOES have a huge impact).

So for the headline, we want to have a gradient of headlines. I like to hit different emotional triggers and see how far I can push each one.

For example, I'll split test a range of emotional/benefits triggers: (Here's my brainstorm)
- Hyperhour increases worker performance (Gain)
- Hyperhour saves you money (Fear of loss)
- Hyperhour gives you control (Feeling of power)
- Hyperhour helps you feel secure (Peace of mind, paranoia)
- Hyperhour helps bring your team together (Friendship, love, etc)

Once I know all the emotional triggers I'm trying to target, it's time to start SPLIT TESTING the crap out of them!

Step 3.
Actual split testing is fun... and I'll include SOME of the results thus far because I know that it's the juice that everyone wants to see anyways

Here's me working specifically the SECURE, PEACE OF MIND angle.

Here are the headlines being tested:

#0 Original: Manage your employees, without being intrusive, without any maintenance…

#1 Little Aggressive: Track Your Employees Work, Without being intrustive, without any maintenance…

#2 More Aggressive: Track Your Employees and Know EXACTLY What Is Happening Inside Your Company

#3 Super Aggressive: Big Brother Employee Tracking: Screenshots, Time Reports For Your Business

#4 Aggressive Paranoia: Never Be Taken Advantage Of Again By Your Employees: Hyperhour Time Tracking

Cool, so as you can see, we have a small amount of headlines that have varying degrees of intensity. The idea behind split testing like this is that you can get a better read on what people REALLY want.

Do they respond well to the thought of their employees stealing? Or maybe they don't like that idea and they prefer the idea of saving money?

Step 4: Let the traffic flow!

Now if you already have an established funnel & traffic sources (for instance Hyperhour has a kick ass affiliate program, so people are constantly sending a bunch of traffic to them)

BUT

Let's assume you don't have affiliates sending traffic left and right... what do you do?

Simple, load up Google adwords, throw in $50 and "play ball!"

Seriously, $50 in PPC will get you more than you need to know in traffic, conversions, etc. Fortunately, we play with a much higher budget, but any amount in Adwords is a great way to get "near instant" split testing results... even if you don't know a thing about Adwords.

Remember, the idea isn't to make your Adwords campaign profitable... it's JUST to split test your changes to see which one is the best. Once you're done, you can go back to any traffic generation methods that you like.

Step 5: Results

Ok results, so what did the best? The conservative "Manage Your Employees" headline or the hyper aggressive headlines?

Well, it was a toss-up that I really didn't expect.

I tracked the conversion from index.php -> subscribe.php results... in other words, how many people saw the first page... and then went to the sign up page. (Obviously, I'm also tracking sales, but that's more private numbers. Over 46 sales were generated during the experiment as I type this)

#0 - Original Page 53.84615385
#1 - Little Aggressive 41.66666667
#2 - More Aggressive 44.44444444
#3 - Super Aggressive 28.57142857
#4 - Aggressive Paranoia 53.32384432

COOL!

So we learned a bunch of awesome stuff from a quick split testing session.

FIRST, the headline has a DRAMATIC effect on your product. Having changed nothing else, the conversions went from 28.57% to 53.84%.

SECOND, it gives us a great read on how people feel. Instead of having random headlines, we now know that people respond well to the idea of having a healthy team INSTEAD of being super aggressive. (Makes sense, but you have to test!)

They also seem to respond very well to paranoia... "Never be taken advantage of again!" seems to really hit home with businesses that have had less than honest employees in the past.

Step 6. Expand, improve and repeat

Cool, so now we've done a simple split test based on ONE emotional trigger... next we go and test a completely different category. For instance, the next category will concentrate on how Hyperhour saves you a bunch of money.

Once we have the "winners" of each emotional category, then we pit them against each other and have an ULTIMATE SPLIT TESTING BATTLE with all the winners. It's like American Idol for internet marketing.

Split testing gives you unbelievable insights on how your pages are doing, on your target customers and it's actually incredibly fun to do (because this is the part where you can try all your wacky ideas). I can't wait to start testing the next pages

Hope this helps! Feel free to ask me any questions,

p.s. Try to send a minimum of 500 (and 1000 visitors is recommended) to the site to get an accurate conversion assessment.
#businesses #efficient #guide #quick #split
  • Profile picture of the author MichaelSJohn
    Um... this is amazing! I can't believe all the goodies in here. You obviously do this business.
    {{ DiscussionBoard.errors[5637503].message }}
  • Profile picture of the author aminur
    Split test is very important. not many people are wiling to accept it. split test can make or break a campaign quick.
    {{ DiscussionBoard.errors[5637642].message }}
    • Profile picture of the author r30ducez
      Great post! I dismissed the importance of split testing when I first started out. But now, after realizing the importance of split testing, It is one of the most important parts of my campaigns.
      {{ DiscussionBoard.errors[5638892].message }}
  • Profile picture of the author davejug1
    Thanks for that mate, I posted a few days ago that I was really surprised there was a lack of split-testing WSOs, it really is vital to your success.

    You've gone and trumped that by posting for free.
    Signature
    FREE List Building help. Click here!

    Yes I do have freebies!

    Expertise comes not through knowledge or skills, but through practice
    {{ DiscussionBoard.errors[5638925].message }}
  • Profile picture of the author drmani
    Originally Posted by Eric Lancheres View Post

    You've probably heard it before... split testing is everything. If you can bump conversion even by 1%-5%, you can increase your net profits by several thousands of dollars.
    Split tests are fun!

    And headline tweaks are awesome.

    I'm running one with 6 different headlines using Google Web Optimizer.

    Original - 50%
    #1 - 0%
    #2 - 20%
    #3 - 16.6%
    #4 - 100%
    #5 - 33.3%

    NOT statistically significant - total sample size is too small.

    Still, intriguing.

    Test away!

    Thanks for the nice post, Eric.

    All success
    Dr.Mani
    Signature
    The Heart Bookstore | Buy a Book, Help a Child Live!
    Email Marketing Tips | How To Focus Better | Time Management
    GET YOUR FREE GUIDE: The 33:33 System
    {{ DiscussionBoard.errors[5639503].message }}
  • Profile picture of the author lucidsuccess
    use the craigslist ad tracker.
    {{ DiscussionBoard.errors[5639631].message }}
  • Profile picture of the author Chris Thompson
    I've been using Google Website Optimizer, but WOW, I am really impressed with the features of Optimizely. I like how you can do a live test on your site without signing up. I had no idea the visual editor was so powerful.

    The other one that people have mentioned to me in the past is Visual Website Optimizer. It looks pretty similar. Pricing plans are a bit different. Not higher or lower, just different ways of segmenting capabilities vs price.
    {{ DiscussionBoard.errors[5639859].message }}
  • Profile picture of the author Eric Lancheres
    Yeah, Optimizely makes things... stupid simple.

    I just checked out the video for visual website optimizer and I really like the heatmap option they have.

    The experiments are still running, and the results are pretty consistent. I'm excited to try new tests... but I keep on telling myself "Don't change it too fast... I need large amounts of traffic to have accurate results!"

    Already have my next experiment in mind, it's going to be great
    {{ DiscussionBoard.errors[5640087].message }}
  • Profile picture of the author Chris Thompson
    Eric - your comment about large amounts of traffic requires is BANG ON and people don't actually realize this most of the time.

    Here's some mathematical truth.

    Say you sent 1000 visitors to an A/B split. So 500 visitors per page.
    Say you have 5 "sales" (1%) on your control.
    Do you think 8 sales on your variation page would determine a winner?

    It's not enough to statistically prove a winner.

    But surely 10 sales (versus 5 on the control) is enough, right?
    Wrong. Not enough.

    12 sales? Nope. Not enough.
    13 sales - yes, finally 13 proves you have a winner.

    Why do you need 13 sales versus 5? Because 1000 visitors (in total) is NOT ENOUGH.

    If you did a test of 10,000 visitors and you had 50 sales on page A versus 70 sales on Page B, that would be enough. That's a 10x larger sample size.

    So bottom line is you need a lot of traffic to determine a winner on a split test unless your results are incredibly huge (i.e. more than 100% better)
    {{ DiscussionBoard.errors[5652725].message }}
  • Profile picture of the author steph03
    Thanks a lot! So many times, I dunno what direction to take to present my products on the homepage. Different people get attracted by different elements and styles of writing on a page, and most of the time it's trial and error that will determine what best attracts your type of clientele. With split testing, I won't waste any time finding out, as I'll be doing it in parallel!

    Thanks again!
    {{ DiscussionBoard.errors[5656729].message }}

Trending Topics