Interesting Split Tests Result

20 replies
We just sent out two packages

They each contained a sales letter.

One Had THIS Headline:

"Give Me 60 Minutes 1-On-1 Over the Phone and I'll Solve Your Biggest, Hardest, and Most 'Frustrating' Marketing Problem... PLUS I'll Give You a Brilliant 'Marketing Package' Worth $597.00 TOTALLY FREE OF CHARGE..."

The Other Had THIS Headline:

Amazing secret exposed: why your website
isn't driving sales and what to do about it..."

Now here's the thing... I wrote the first one and a leading Australian copywriter suggested the second.

The body copy in each mail out was identical. We are selling websites to the offline market.

The first one is kicking butt. I mean 'dancing a jig' Chris-is-one-happy-young-man-well

The second, so far, has not resulted in even a single call.

Anyway, I have heard heaps lately about how "People Just Don't Read Long Headlines Anymore..." Yada yada yada.

My experience is quite the opposite. In fact I'd go so far as to say that the ONLY place short headlines work is in Classified Ads.

What has your experience been?
#copywriting results #interesting #result #split #split tests #tests
  • Profile picture of the author xohaibx
    Short Headline Vs. Long One ...

    This is an old debate and your results are definitely interesting.

    Here's my take on it: What's more important than the length of your headline is how you say it. Sometimes a few words are enough to pass on the message and there are times when you have to use a longer headline to get the point across.

    I've noticed that longer headlines work as long as you're not beating around the bush.

    In your example, the shorter headline hardly conveyed any excitement - it just looked cold. While the longer one looked 'adrenaline-pumped' and also successfully conveyed your unique selling point. It had power. It touched 'emotions'. It gave details while maintaining the curiosity. And hence got better results.

    The key here is to ensure that your headline is to the point and isn't vague in any way. That's all that matters.
    {{ DiscussionBoard.errors[4924682].message }}
    • Profile picture of the author Warrior X
      Originally Posted by Mustafa Khundmiri View Post


      In your example, the shorter headline hardly conveyed any excitement - it just looked cold. While the longer one looked 'adrenaline-pumped' and also successfully conveyed your unique selling point. It had power. It touched 'emotions'. It gave details while maintaining the curiosity. And hence got better results.
      Agreed, this debate isn't about short vs. long. The two headlines simply aren't of equal quality IMHO. The first has an irresistible offer, the second doesn't. End of story.
      Signature
      #1 In WHITEBOARD VIDEOS - Great Way To Tell Your Story!
      Available Here
      {{ DiscussionBoard.errors[4924707].message }}
      • Profile picture of the author PatrickP
        Originally Posted by TrustedCopy View Post

        Agreed, this debate isn't about short vs. long. The two headlines simply aren't of equal quality IMHO. The first has an irresistible offer, the second doesn't. End of story.
        Agreed.

        Long vs short would have been more like the long one compared to something like

        Brilliant 'Marketing Package' Worth $597.00 TOTALLY FREE OF CHARGE..."
        {{ DiscussionBoard.errors[4924768].message }}
  • Profile picture of the author dadamson
    This is an interesting result. Just looking at it I would probably click through the second one instead of the first one, so I am intrigued about this.

    Just shows that split testing everything is extremely important.

    How are you generating your email list. Is it through people who have previously purchased through you or contacted you via phone, or are you offering freebies in exchange of a signup?

    I think the method that the person signs up is extremely crutial to the conversion rates in ANY email marketing campaign. If you put the same split test up on someone elses list you may get opposite results.

    It's all about the particular mindset that you attract through your website both conciously and subconsiously.

    Cudos to you split testing!
    {{ DiscussionBoard.errors[4924703].message }}
  • Profile picture of the author ExquisiteMedia
    I definitely see more value in the first one to be honest. The second one just makes me think that once I open the e-mail I'm going to have to work my tail off to fix my website. Then again it does depend on your target audience as everyone has their own mindset and their own way of absorbing words.
    {{ DiscussionBoard.errors[4924756].message }}
  • Profile picture of the author onSubie
    Hi

    That is interesting. I think your target market will have an impact as well.

    You say you are selling websites to offline businesses. Since they are offline, many may not have as much experience with online marketing.

    They may also need more hand-holding and are at a point where they don't really know where to start so the quick promise of a 1-hour consultation (where they can ask about "the catch") and a free marketing package would be appealing.

    The second headline, I think, would be more effective with Internet Marketers or more experienced online businesses that are more familiar with the IM marketing approach of a "secret" and vague or no description of what you get.

    Pavlov's dog didn't salivate when you blew a whistle.

    Was the 'expert" opinion given after looking at your business, your market and your marketing plan? Or was it offered up as a suggestion based on email or an informal discussion?

    Edit: You say the copy was identical. Was the 60 minute 1-on-1 and free marketing package described in the copy? Maybe it's a case of the headline not driving people to read the copy, where with your headline they don't need to. You pretty much tell them what they are getting right in the headline.

    Mahlon
    {{ DiscussionBoard.errors[4924820].message }}
  • Profile picture of the author Pusateri
    Love the first one. It pegs the meters for relevance and curiosity. It's bold and personal. You also used three words that trigger sexual associations in many peoples minds (especially the way you used them together). Don't discount the power of these subconscious associations.

    The second one is what people expect to read in a sales letter. Yawn. Crumple. Trash. Would have been better off using a random line from Shakespeare. At least then they would wonder what the hell is going on.
    {{ DiscussionBoard.errors[4924927].message }}
  • Profile picture of the author apolwar
    Originally Posted by copywriter View Post

    We just sent out two packages

    They each contained a sales letter.

    One Had THIS Headline:

    "Give Me 60 Minutes 1-On-1 Over the Phone and I'll Solve Your Biggest, Hardest, and Most 'Frustrating' Marketing Problem... PLUS I'll Give You a Brilliant 'Marketing Package' Worth $597.00 TOTALLY FREE OF CHARGE..."

    The Other Had THIS Headline:

    Amazing secret exposed: why your website
    isn't driving sales and what to do about it..."

    Now here's the thing... I wrote the first one and a leading Australian copywriter suggested the second.

    The body copy in each mail out was identical. We are selling websites to the offline market.

    The first one is kicking butt. I mean 'dancing a jig' Chris-is-one-happy-young-man-well

    The second, so far, has not resulted in even a single call.

    Anyway, I have heard heaps lately about how "People Just Don't Read Long Headlines Anymore..." Yada yada yada.

    My experience is quite the opposite. In fact I'd go so far as to say that the ONLY place short headlines work is in Classified Ads.

    What has your experience been?
    The longer headline was clearer than the shorter one. Its a big plus for clients to be able to understand better what the headline was about.

    Also putting the value on the headline made was a risk but against a headline that wasn't clear made the people think your product and company is trustworthy.
    {{ DiscussionBoard.errors[4925118].message }}
  • Profile picture of the author Daniel Scott
    Interesting, but without knowing the context of the rest of the letter and the target market your results don't mean a lot.

    Don't get me wrong... I think it's great you're testing and sharing. But you've taken one piece of the promotion out of context.

    A headline isn't an independent entity. It's part of the whole process (including the type of envelope you use to get people to open it).

    I think if you took out the "amazing secret revealed" part the second one could actually kick a lot of ass... depending on who you were targeting, of course.

    -Daniel
    Signature

    Always looking for badass direct-response copywriters. PM me if we don't know each other and you're looking for work.

    {{ DiscussionBoard.errors[4925301].message }}
    • Profile picture of the author ewenmack
      Thanks Chris for posting your results.

      If you were to ask yourself...

      "Which headline with a ph. number to call,
      and nothing else, would most likely get the reader to call?"

      My money would be on the one that clearly states the offer
      and gives the most advantage to the busy reader.

      You may of heard it before, but it's worth repeating,
      the offer trumps the copy.

      Best,
      Ewen
      {{ DiscussionBoard.errors[4925593].message }}
  • Profile picture of the author Kunle Olomofe
    Let me precede my advice by being honest...

    For many, many years, I used to be the last person you would go to for headline writing advice. However, a short time ago, I discovered a very specific type of headline technique that works like crazy that I have now successfully taught to NON-copywriters and NON-marketers(offline), I mean average folks who have never HEARD of the phrase "direct marketing sales letters" in their lives and they all... 100% of them started writing KILLER headlines in as little as 2-10 mins per headline... the one major factor that helped these less-than-newbies write killer headlines at the drop of a hat?....

    1. SPECIFICS.

    That's one thing that made the OP's headline work better than the second one. People LOVE specifics because the human brain processes information in terms of getting results, solutions to pressing dilemmas, etc, and specific information--not just numbers, but anything SPECIFIC--will simply help to draw in people who really want a solution.... NOW.

    Non-spec headlines also work, but I'd be willing to wager that to the right market, a headline with specifics in it will always outperform one without. That's what happened in the OP's test.

    2. LENGTH IS LARGELY INCONSEQUENTIAL.

    If the second headline offered specifics it would also be doing well. I have heard tell that 17 words is the perfect length for a good headline and the truth is that if the headline is much longer it does often times get boring to read or it looks way too long to some folks for them to WANT to read it. Trust me that is a fact I know from personal experience as a prospect AND a copywriter.

    However, if your headline is too short it may not have enough much needed information to convey that drop kick effect you really need to grab their interest and keep them reading and/or get them buying.

    However (and here's the kicker)...

    If your headline is as long as say 50 words (I'm exaggerating but lets just say that for arguments sake)...if your headline was 50 words and you had specifics all over the thing, it would likely outperform a 17 word headline that didn't offer any (or limited) specific information, that is for example, a teaser or question headline without any specific numbers, dates, ages, status, location etc in it.

    3. MOST IF NOT ALL COPYWRITING AND MARKETING TESTS ARE INCONCLUSIVE.

    Your tests and mine and virtually every other person's tests in this industry are more often than not inconclusive and they probably always will be until we all conduct our tests on the exact same audience in ultra-controlled and monitored situations--the way real world scientists do.

    The latter is simply because all audiences ARE different, no matter what you've been taught, sorry to dispel that myth but there is no such thing as one size fits all copywriting... yes, the AIDA formula will probably always work, and yes super headlines will probably always work, but the kinds of colors, words, phrases, context, specifics, promises etc that you use in your headline and body copy will almost always have to vary depending on YOUR specific audience.

    So, OP, I wouldn't get too excited about debunking what many experts have said (re your headline test), since half the time, many experts don't know what they are talking about, and they have only been getting away with their B.S. because people like you don't try to debunk their crazy claims often enough So, well done... I'd love to see more crazy claims debunked in this way, it's about time

    4. EXPERTS ARE NOT INFALLIBLE.

    Finishing up with the "experts"...

    I'm glad you have seen that the fact someone claims or is claimed by others to be an expert often doesn't mean squat... experts are humans thus they are fallible... period.

    Don't live by an expert's every word or breath.

    Listen to experts with caution and do your own due diligence whenever you want to do anything... hooks, lines and sinkers are used to catch fish for sport or food... if you take the baits that keep being thrown out there, you're either sport or food.

    Bottom line, learn from people and then use your own brains just like the OP has done, it almost always works out for the best.

    Cheers,

    Kunle Olomofe

    PS: Simply throwing specifics like numbers into a headline will NOT give you the best results, like anything else in this world you have to do it the correct way, in the best way possible and with the purest of intentions for you to always get the absolute best results possible from a campaign.

    PPS: I agree with Ewen, the offer trumps the copy 100% of the time... I'd venture to boldly say... in any market and to any audience... but then, that's left for someone else to debunk with another well planned stress test..;-)
    Signature
    Celebrity Marketing Formula - How To Quickly Become A Celebrated Authority In ANY Industry/Niche... Coming Soon.
    {{ DiscussionBoard.errors[4925605].message }}
    • Profile picture of the author ewenmack
      To back up the reason why the first headline worked so well
      by it stating an offer, here's tests done by Bob Bly's clients...

      one weired change in the offer resulted in 10 times more revenue!

      How to Create Irresistible Offers

      Enjoy!
      Ewen
      {{ DiscussionBoard.errors[4925828].message }}
      • I can see why the first headline worked so well -

        It gave an Irresistible Offer.

        You could pump up the second headline to do the same.

        But no need - you're getting a brilliant response.

        Which is exactly what you want.


        Steve
        {{ DiscussionBoard.errors[4925868].message }}
        • Profile picture of the author ARSuarez
          Because the first one sounds like a man on coke, and the second sounds like a 75 year old senior who needs Viagra.

          Personally, I don't know if this is an adequate test. There is a clear difference in the amount of work that went into the first versus the second.

          The headline might actually have had more potential if the same elements were applied:

          "Are These 6 Fatal Mistakes Killing Your Web Sales?"

          "6 Fatal Website Mistakes... 9 Ways To Fix Them In 15 Minutes"

          "Give Me 15 Minutes And I'll Triple Your Website's Profits"

          Or an ol' Richard Armstrong swipe...

          "Why The HELL Doesn't My Website Sell Anything?"

          (That is a dominant emotion headline - go for what they're feeling).

          I'm not trying to bust your chops, or anyone else who responded... but there is a clear quality difference between those headlines.

          It's like comparing the taste of a ripe banana to one that's still green.

          Put some work into it and craft a strong headline... one that doesn't look like a direct, cookie-cutter rip.

          For example, I would think a good test is...

          Revealed inside...

          "Why The HELL Doesn't This Website Sell Anything?!"

          9 ways to fix the most common - but fatal - website selling mistakes in just 20 minutes. And even better - how you can claim a 'Marketing Makeover' package, valued at $597...
          absolutely free of charge.

          Do you see the comparative difference?

          One headline, from eyebrow to deck, has momentum, benefit, and emotion.

          Only your first headline states a benefit and resonates emotionally - the second 'hints' at a benefit and comes off bone dry.

          Any way, I've spent a lot of time on this. Hope it helps you with future tests.

          Warmly,

          Angel
          {{ DiscussionBoard.errors[4928280].message }}
  • Profile picture of the author Warrior X
    "Why The HELL Doesn't This Website Sell Anything?!"
    That's a great headline that I will be swiping in the very near future
    Signature
    #1 In WHITEBOARD VIDEOS - Great Way To Tell Your Story!
    Available Here
    {{ DiscussionBoard.errors[4928473].message }}
    • Originally Posted by TrustedCopy View Post

      "Why The HELL Doesn't This Website Sell Anything?!"
      That's a great headline that I will be swiping in the very near future
      Yes it is a great headline - actually it's more of a subhead - before the main headline.

      But I would change it to -

      "Why The Hell Doesn't Your Website Sell Anything?"

      Put in "your" rather than "this" to avoid any confusion.

      Steve
      {{ DiscussionBoard.errors[4928816].message }}
      • Profile picture of the author ARSuarez
        Originally Posted by Steve Copywriter View Post

        Yes it is a great headline - actually it's more of a subhead - before the main headline.

        But I would change it to -

        "Why The Hell Doesn't Your Website Sell Anything?"

        Put in "your" rather than "this" to avoid any confusion.

        Steve
        Hey Steven,

        Thanks for chiming in.

        But I have to say I disagree.

        It's a dominant emotional headline - it is intended to be front and center.

        The Richard Armstrong promo it was swiped from is this:

        "What In The World Is Wrong With Me?"

        It gets the reader's emotional engine started...

        "Damn right. Why the **** isn't this thing selling? I paid a lot of damn money to have it put up and I've made ONE sale on all this traffic!"

        A better lead-in (the copy right before the headline) is, "Finally - the answer..." or "<Specialist> reveals at last..."

        I usually follow this model/formula:

        <lead-in: Credibility, preparation, or audience designation>

        <headline: strong statement or assertion - could be benefit or simply a strong statement of intrigue with implied benefit>

        <deck copy: HEAVY on benefits - gain, gain, gain. And specifics.>

        <Opening sentence: pay off for headline by reference>

        I don't think sticking that headline - or that type of headline - in the shadow of something else delivers the impact.

        But, at the end of the day, it's all subject to testing.

        Warmly,

        Angel
        {{ DiscussionBoard.errors[4928936].message }}
        • Profile picture of the author ThomasOMalley
          Keep up the excellent work. Keep going with the headline that gets the best response.

          Don't get thrown off by comments re. it depends on the context...the bottom line is you have done a test and you have found a headline that works better than the other...with everything else being equal.

          Great work.
          {{ DiscussionBoard.errors[4928985].message }}
        • Angel,

          Well, Richard Armstrong is a brilliant copywriter.

          So, do what he suggests.

          Steve

          BTW - His Book "God Doesn't Shoot Craps" is an absolutely cracking read.
          {{ DiscussionBoard.errors[4928999].message }}
          • Profile picture of the author copywriter
            Hi Gang

            Really appreciate all the response and great feedback!

            I loved Angel's re-write and will test that. One thing I have learned and am very grateful for is that I have zero ego as a copywriter when it comes to suggestions - even after creating tens of millions of dollars in combined sales.

            Feedback is utterly priceless as it can save you a fortune and improve your results. Sometimes the things we are dead-certain will work just fall flat on their face.

            For instance: I wrote a piece for a client that was giving away $150 worth of MYER Vouchers every week to clients who ordered X amount of product. (MYER is an Australian store like JC Penny)

            The offer totally bombed.

            I called some of the target market and asked them "What would have influenced you?" and one young lady said "Movie Tickets - I LOVE going to the movies!"

            We sent the same offer but this time, they were offered 2 Free Movie Tickets.

            The offer brought in over $570.000 in new business over the next 5 months!

            Go figure! People chose a couple of free movie tickets over $150 in free vouchers they could have spent at one of the cities best stores!

            To this day that one has me totally stumped!
            Signature

            Unique Facebook Group Reveals How to Explode Your Influence http://www.facebook.com/groups/lawofinfluence

            {{ DiscussionBoard.errors[4929528].message }}

Trending Topics