Very Small Mailing: Should I Even Split Test?

by 14 replies
17
Hi all;

I'm doing a targeted mailing of about 30 letters to a group of my ideal prospects. I'd like to test a couple of ideas for the campaign, but the mailing is very small and I can not justify a bigger mailing at this time (I'm going after clients for a new venture and can't handle more than 1-2 to start. This is a multi-step campaign so I will be contacting them repeatedly).

Is there any reason to test more than one mail campaign on a list of 30?

Thanks
#offline marketing #mailing #small #split
  • I personally can't see this giving any sort of insights into how well the piece converts.

    I'd test one piece with atleast 100 mailings alone.
    • [ 1 ] Thanks
  • No, that is way too small of a sample size. Even 100 each is too small. In my opinion, 1,000 each is too small but I guess that would give you an idea.
    • [ 1 ] Thanks
    • [1] reply
    • I'm thinking about doing a B2B postcard direct mailing. What would a good number of pieces to test my initial mailing?
      • [1] reply
  • i agree both above posts. 30 is too small to have a valid conclusion. I would be using split test with mails of at least in range of 300 -500.
    hope it helps
    • [ 1 ] Thanks
  • I heard for split test you are suppose to at least do 500 to see results on it. Minimum.
  • It's too small to really draw any conclusions, but it's not too small to *try*. Why not send 15 to one group, 15 to another group, do your split testing and see? If one group gets 5 responses, and the other gets none, you'll at least have a better idea what to send out next time than if you had sent all 30 to one group and gotten 1 or 2 responses.
    • [ 1 ] Thanks
  • Yeah don't worry about split testing. The sample size is waaay too small to give a result that is meaningful, unless you get a MASSIVE swing in results i.e no sales from one sample all from another.

    Chances are the difference would not be that big I wouldn't bother with the extra effort.
    • [ 1 ] Thanks
  • I was a Manufacturing Engineer (i.e. Industrial Engineer) for 10 years and often had to make decisions based on a very small universe of samples. If I were only contacting 30 prospects, and had two possible emails, I would split the group. The difference I guess is your control and analysis.

    Split-Testing is a science in itself, but I'd rather send 2 messages to 30 people and get a hit on one of them, than just send the same message to 30 and not hear anything.
  • maybe 100 emails so you can do split testing. what software or application you are using to send emails?
    • [1] reply
    • Emails? I do split testing with 20K sample size lol.

      I take that back, I split test subject lines out of 2K first.
Join the discussion

Next Topics on Trending Feed

  • 17

    Very Small Mailing: Should I Even Split Test?

    Hi all; I'm doing a targeted mailing of about 30 letters to a group of my ideal prospects. I'd like to test a couple of ideas for the campaign, but the mailing is very small and I can not justify a bigger mailing at this time (I'm going after clients for a new venture and can't handle more than 1-2 to start. This is a multi-step campaign so I will be contacting them repeatedly).