8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

How to A/B test an entire "website model" (not just a single page)

by Bkelly301
7 replies
If I could figure out how to do what I'm trying to do, it would be SO HELPFUL!!

I understand how to A/B test a single page such as an opt-in page or a sales page, but what I'm more concerned with is split testing my entire website model.

Every once in a while I'll make a change to the "flow" of my website. My website has a TON of content, some of which is free along with the "paid section". People sign up for free, and there are certain things that they have access to as a free member. If they decide that they like the site enough to upgrade, then they head over to the sales page and make the payment.

I'm constantly tweaking the site in an attempt to optimize this model. I want people to see the "upgrade" as a no-brainer.

I never had a way to test 2 variations of this website model though. My "testing" has always been simply to initiate some changes, then leave it sit for about a month and see if it seems like I am making more sales or less sales. There's no real "data" to collect this way though.

I'm still only using free traffic too, so it's not as simple as setting up a duplicate site with the variant model and then just seeing what happens. I have almost 200 YouTube videos all promoting my one main site. Therefore, setting up a second site on a new domain absolutely wouldn't perform as well.

I'm not sure if it is possible to do what I am trying to do, but I figured it can't hurt to ask. Thanks!
#a or b #entire #page #single #website model
Avatar of Unregistered
  • Profile picture of the author Steven of Polonius
    The main snag is that the videos all already point to the existing URL. Could you buy TWO new domains that sound similar? One houses a duplicate of the current site, and the other has a test variation. Then take the existing domain (that's linked in the videos) and use that now as a "splitter" using a tool like Split Test Monkey or something, to siphon 50% to the existing site (on the new domain) and 50% to the new variation (on the other new domain). Then use a software like Funnelytics to track how all the traffic moves around via both sites after being split.

    When I lay it all out, it sounds like way more work than its worth lol.
    Signature

    "Steven knows a thing or two about beating the odds" - Shark Tank's Kevin Harrington
    {{ DiscussionBoard.errors[11587876].message }}
    • Profile picture of the author Art Vandaley
      I did this once, the two domains suggestions is great. I simply added one letter to where you couldn't tell the difference. It took a min to get the kinks worked out as far as pointing the domain in the right direction, but I made it happen.
      {{ DiscussionBoard.errors[11619113].message }}
  • Profile picture of the author IGotMine
    Use a rotator for your video link. It will allow you to have two completely different sites and set the percentage of traffic to each. You could also add more sites if you want and set the percentage of traffic for each.
    Signature
    {{ DiscussionBoard.errors[11587938].message }}
  • Profile picture of the author savidge4
    Bkelly.. you really need to dig deep and research A/B testing... the absolute basics is you are changing out Page A with Page B, and then back to page A and then back to Page B over and over and over until you get a "Result" be it good bad or indifferent.

    So what this looks like is say your home page you Have the Original or Page A and then you have an element you want to test on a copy of the same page or Page B. The testing software - and again Google Analytics allows you to do this ( https://support.google.com/optimize/.../6211930?hl=en ) switches the 2 choices back and forth and back and forth as traffic comes across it.

    ITS A GOOD THING you have a steady stream of traffic pointing in one direction.

    You just are not understanding the A/B testing aspect of this. you don't need a duplicate site. THIS is simply not a requirement of any way shape or form to "Do" A/B testing.

    Again use the link above follow the steps and set up your actual first A/B test even if it is on some way back page of your site to understand the process

    I will GUARANTEE once you REALLY understand this.. you will become addicted. YOU will start making decisions based on DATA. It will no longer be about you thinking, or feeling.. DATA will rule your world. Its from this frame of mind that Growth will begin and you will without question SEE IT.

    And anyone else reading this... testing is the key. Its overly important to have traffic coming across the page or pages you want to test. 50 visits a week simply will not get you in any way shape or form decent results. As a professional doing this I look for clients that have something like 30,000 visits per month across test pages to give you an example of an extreme.

    So traffic is probably the most important element. I find that the order you test pages is important as well. I read many test from the back end forward. I prefer testing from the Front to the back. So a generic example I think most reading this will understand. An Ad, A lander page with e-mail opt in, and then a thank you page.

    I personally test the AD first. I will run 2 3 5 different ads to see which one gets the most clicks IE Traffic. I pull the duds and ad more and more until I have 2 or 3 solid traffic earning ads. At this point I am not so concerned with what happens on the landing page. This is fairly important to remember... in this very simply 3 part funnel you don't want to be changing things around while you are testing any one or the other.

    IF you are running say facebook ads and your ad is not getting a 3% click through rate there is without question room for improvement. The language, the headline, the graphic, your targeting... 3% is what I would consider a bare minimum base line to shoot for. 100 impressions and no clicks? CHANGE THE AD... don't waste another penny.. something is wrong. Don't change the WHOLE AD... just a portion

    So once you have the ad "Performing" you want to start testing the optin page. I literally test from the top down. Headline first. Byline. Bullet points. testimonials. and then the actual Optin button. depending on the numbers I might test up and down this page 2 or 3 times until I am somewhere over the 10% conversion mark.

    Something to keep in mind. 3% conversion on an optin page is a baseline number you want to see. if you are less than 3% there is without question room for improvement. For ME 3% says you are on the right track, and then its just a matter of testing to get better and better results.

    From here depending on your thank you page you will want to test that as well. If you have an upsell, or you want them to visit your website or whatever the result you are looking for is. Its basically another Ad right?

    the GREATEST thing testing will do for you is take YOU out of the equation. How many times have we read here or you have thought ( myself included ) that is damn good looking ad and it performed like doo doo? Testing removes Thought and Emotion right out of the process. The cream that rises to the top is what DATA says is cream - what is PROVEN to be cream... in no way shape or form what you feel and what you think cream is.

    Bkelly, I hope this helps you on your AWESOME journey of success! KEEP AT IT MAN!

    And I hope through Bkelly's sharing here on the Warrior Forum that his questions and mine and other members answers will help others!

    Be safe and wash your hands!
    Signature
    Success is an ACT not an idea
    {{ DiscussionBoard.errors[11587953].message }}
    • Profile picture of the author Bkelly301
      Originally Posted by savidge4 View Post

      I will GUARANTEE once you REALLY understand this.. you will become addicted. YOU will start making decisions based on DATA. It will no longer be about you thinking, or feeling.. DATA will rule your world. Its from this frame of mind that Growth will begin and you will without question SEE IT.
      Hey thanks for the reply. I do understand the purpose of A/B testing. However, I don't know what exactly to test based on my model. Most of what you are talking about here applies to a simple 3-page funnel, where you send paid traffic to via. one single link...

      Ad --> Link --> Landing Page/Optin --> Thank you page/sales page

      With a simple funnel like that, I would have been testing and optimizing for a while now...However, with the "freemium model" (as someone on here called it before), things aren't as straightforward.

      I have about 180 YouTube videos. Each of the 180 videos has a duplicate "website version", which not only contains the video but also a written lesson and a bunch of extra stuff that is included for members.

      In the description of my YouTube videos, I usually have about 5 to 10 links pointing to "relevant lessons", as well as to my home page and to the main sales page. So there are infinite ways that people are arriving at my site. It's not just one single link.

      Once they arrive at my site, they usually become a "Free member", where they browse around my free content before deciding if they want to pay the one-time fee to "upgrade". Once upgrading they are given access to about 200 in-depth tutorials, 19 courses and about 2000 other videos (it's a lot of stuff).

      Some people remain free members forever. Others upgrade right away. Some wait for me to have a sale, and then they upgrade. Others upgrade after they are "reminded" that I even exist after receiving one of my monthly newsletters.

      Point being...is that people have usually already made up their minds prior to even arriving at the final checkout page. Sure I could attempt to optimize this page, but there's a million factors that come in to play prior to them even getting there. There are several things that I would like to "test" with this model, but there's so many different variables and possible "paths" that someone may take prior to them paying for the upgrade.

      ANYWAY...

      With all that said, here are the two primary things that I would like to A/B test in order to try and optimize:
      • Give the "free members" a lot of free content to sample vs. give the "free members" just a little bit of free content to sample
      • Have multiple "courses" to sell along with the "full access" option vs. only having the "full access" upgrade option (my current model)

      I'm sure that I'm over complicating things, which I have the tendency to do a lot, but I'm dying to find a solution here!!

      The first reply in this thread seems to be the one that would most likely allow me to do what I am looking to do, but I can't really see a way to actually put that into practice.

      I keep thinking that I should just bail on this project, and do things the "normal" way...set up a simple 3-page funnel that sells a single "course".

      I just get so many compliments on this site from everyone that uses it. I have been working on it for over 4 years now. I feel like it has SO MUCH potential, but there's just something that I'm missing. The coach that I paid $5000 to last year told me that he thinks I should be clearing $100,000 per year from the site EASILY. Both him and I feel like I'm sitting on a goldmine, but I have no clue how to "cash in". If that makes any sense?
      {{ DiscussionBoard.errors[11588059].message }}
      • Profile picture of the author savidge4
        Originally Posted by Bkelly301 View Post

        Hey thanks for the reply. I do understand the purpose of A/B testing. However, I don't know what exactly to test based on my model. Most of what you are talking about here applies to a simple 3-page funnel, where you send paid traffic to via. one single link...

        Ad --> Link --> Landing Page/Optin --> Thank you page/sales page

        With a simple funnel like that, I would have been testing and optimizing for a while now...However, with the "freemium model" (as someone on here called it before), things aren't as straightforward.
        It is straightforward... You just have more than one funnel. Its not complicated, its scaled.

        Originally Posted by Bkelly301 View Post

        I have about 180 YouTube videos. Each of the 180 videos has a duplicate "website version", which not only contains the video but also a written lesson and a bunch of extra stuff that is included for members.
        180 videos that link to 180 pages... So we can remove testing the links on the youtube descriptions. You HAVE traffic, so that is working.

        You then have 180 pages where you are converting FREE to PAID...

        Originally Posted by Bkelly301 View Post

        In the description of my YouTube videos, I usually have about 5 to 10 links pointing to "relevant lessons", as well as to my home page and to the main sales page. So there are infinite ways that people are arriving at my site. It's not just one single link.
        No its not infinite its 180 pages that are exactly the same with different content and a homepage and a sales page. So there is only three pages.

        A suggestion Make the sales page link from the 180 onsite video with lesson pages different..IE Onsite-Lesson-Sales-Page.htm


        So let me explain the 180 pages of content being the same. Aside from the specific content, they will have the same ads to up grade. The same Authors box, and the same links sprinked. If you look at this from a one page one purpose prospective you have Scaled 180X giving value and trying to sell the upgrade. So anything you test on one page and get a boost in results will apply to the other 179 pages. See what I am saying?

        Your funnel is exactly the same as the simple 3 step model... just SCALED Its not complicated - its scaled. You don't have to test each and every one. Just figure out your 10 most popular and test those and once you have a result of gain in signups, you apply that change across the remaining 100+ pages

        Originally Posted by Bkelly301 View Post

        Once they arrive at my site, they usually become a "Free member", where they browse around my free content before deciding if they want to pay the one-time fee to "upgrade". Once upgrading they are given access to about 200 in-depth tutorials, 19 courses and about 2000 other videos (it's a lot of stuff).

        Some people remain free members forever. Others upgrade right away. Some wait for me to have a sale, and then they upgrade. Others upgrade after they are "reminded" that I even exist after receiving one of my monthly newsletters.

        Point being...is that people have usually already made up their minds prior to even arriving at the final checkout page. Sure I could attempt to optimize this page, but there's a million factors that come in to play prior to them even getting there. There are several things that I would like to "test" with this model, but there's so many different variables and possible "paths" that someone may take prior to them paying for the upgrade.
        Take a deep breath and simplify... there is NOT a million factors, there are only 3 pages. The Value added presales lesson pages replicated 180 times. The home page, and the sales page.

        Originally Posted by Bkelly301 View Post

        With all that said, here are the two primary things that I would like to A/B test in order to try and optimize:
        • Give the "free members" a lot of free content to sample vs. give the "free members" just a little bit of free content to sample
        • Have multiple "courses" to sell along with the "full access" option vs. only having the "full access" upgrade option (my current model)
        We have talked about this...and I think the correct path is to separate these models... you keep thinking you can inject a $100 small course in to a site that is a $59 for everything model. It wont work - If the intent is to sell more $59 All Access Passes - it might work.

        For the model where you are separating the courses into ALA Carte at a higher $ amount you can only create a new site for this and build. YOU know how to build at this point. YOU are good at it.

        I will be blunt. STOP messing with your cash cow EXCEPT for optimizing its ability to convert FREE members to Life Time $59 members. Take on the ALA Carte model as a separate model and go from there.

        Originally Posted by Bkelly301 View Post

        The first reply in this thread seems to be the one that would most likely allow me to do what I am looking to do, but I can't really see a way to actually put that into practice.
        2 sites with the same content to see which works better? uh no... you have a chance at damaging the SEO advantages your primary site has.. and effecting your CASH COW. DONT DO IT.

        Originally Posted by Bkelly301 View Post

        I keep thinking that I should just bail on this project, and do things the "normal" way...set up a simple 3-page funnel that sells a single "course".
        ok just delete the site that pays your bills and start over... reading it like that do you see how crazy the idea is? Just start a new project with the ALA Carte model and focus on creating those funnels. At the same time like described above test and improve the $59 cash cow site and make more money.

        In the end you will end up with 2 Web Properties bringing in CASH. THIS is the start of Scaling your at home business. Your current site for a "first attempt" is SUCCESSFUL and don't ever tell yourself differently. Were there mistakes made along the way? probably. But take those mistakes into the new ALA Cart venture and learn from them.

        I have in excess of 50 sites... that make me money... forget my day job... Forget my eBay side hussle. Its Business at scale. FORD does not make 1 car and sell it... they sell cars and trucks and SUV's and whatever else. GROWTH means more than one. Its ok to have 2 website that make money - MOST cant do it with one - YOU are scaling success and trying to trip over your own feet at ever chance you can give yourself! LOL

        Originally Posted by Bkelly301 View Post

        I just get so many compliments on this site from everyone that uses it. I have been working on it for over 4 years now. I feel like it has SO MUCH potential, but there's just something that I'm missing. The coach that I paid $5000 to last year told me that he thinks I should be clearing $100,000 per year from the site EASILY. Both him and I feel like I'm sitting on a goldmine, but I have no clue how to "cash in". If that makes any sense?
        Sometimes remodeling is far more complicated than just taking down and starting over. In your case you just need to build on the next lot over and leave the primary as it is. Extract the lessons learned.. understand how you want the site structured and go from there.

        Where would you be with the new project today if you had started 3 months ago? Stop procrastinating and get to work LOL
        Signature
        Success is an ACT not an idea
        {{ DiscussionBoard.errors[11588112].message }}
        • Profile picture of the author Bkelly301
          Originally Posted by savidge4 View Post

          A suggestion Make the sales page link from the 180 onsite video with lesson pages different..IE Onsite-Lesson-Sales-Page.htm
          This is a GREAT idea!! Thank you!!


          Originally Posted by savidge4 View Post

          Your funnel is exactly the same as the simple 3 step model... just SCALED Its not complicated - its scaled. You don't have to test each and every one. Just figure out your 10 most popular and test those and once you have a result of gain in signups, you apply that change across the remaining 100+ pages
          This is a great way of looking at it. I never thought of it this way!!


          Originally Posted by savidge4 View Post

          you keep thinking you can inject a $100 small course in to a site that is a $59 for everything model. It wont work - If the intent is to sell more $59 All Access Passes - it might work.
          Well, not necessarily. The goal has always been to increase the price of the "All Access Pass". The other courses on the site would be less money. The site guitarzoom (dot) com is how I would ultimately like my site to be. But I agree 100%, don't mess with the "cash cow", and aside from the website upgrade (to improve the product), I haven't messed with the "model" or the price in over a year.

          BTW, I got the upgraded model doing well again. I had to tweak a ton of stuff, but I'm back to where I was prior to the upgrade AND the people who use the site are MUCH happier now!


          Originally Posted by savidge4 View Post

          I will be blunt. STOP messing with your cash cow EXCEPT for optimizing its ability to convert FREE members to Life Time $59 members.
          Like I said, I'm not messing with it. I'm looking for ways to optimize via. A/B testing. Your replies have been extremely helpful both in this thread and the previous ones!!

          Originally Posted by savidge4 View Post

          2 sites with the same content to see which works better? uh no... you have a chance at damaging the SEO advantages your primary site has.. and effecting your CASH COW. DONT DO IT.
          Well, I didn't really want 2 separate sites. I was just hoping that:
          • Person A signs up as a Free Member and they see Page A, which would be their version of the free membership
          • Person B signs up as a Free Member and they see Page B, which would be variation of the free membership

          I would then go with the model that performed better.

          Originally Posted by savidge4 View Post

          ok just delete the site that pays your bills and start over... reading it like that do you see how crazy the idea is?
          Haha, no way! I didn't mean to delete it. I just meant stop doing anything to it at all...stop trying to "optimize" or add any new content to it so I can focus all my efforts on the next project.

          Originally Posted by savidge4 View Post

          I have in excess of 50 sites... that make me money... forget my day job... Forget my eBay side hussle. Its Business at scale. FORD does not make 1 car and sell it... they sell cars and trucks and SUV's and whatever else. GROWTH means more than one.
          This is my goal. Ideally, I'd like to have 2 to 3 sites that all bring in money. 50....that's insane!! That's awesome though!!

          Originally Posted by savidge4 View Post

          Where would you be with the new project today if you had started 3 months ago? Stop procrastinating and get to work LOL
          You are so right!!
          {{ DiscussionBoard.errors[11588146].message }}
Avatar of Unregistered

Trending Topics