Letter: How Many Pieces Should You Mail?

Share this article:
In his Creative Checklist column, Dean Rieck warns about making decisions based on insignificant results, but doesn't say how many pieces you have to mail to get a statistically valid test.


Ed McLean addressed this topic decades ago in his classic monograph, "The Basics of Testing." In it, he included a table to help the reader determine the minimum acceptable test cell size.


The table shows that to mail with an 85 percent confidence level that your rollout results won't decline more than 25 percent of the test figure, you must mail enough to collect 14 responses. If your response rate is 1 percent, that means each test cell must have 1,400 pieces.


Bob Bly, Copywriter/consultant,Dumont, NJ,


rwbly@bly.com



Share this article:

Sign up to our newsletters

Follow us on Twitter @dmnews

Latest Jobs:

More in Opinions

The Challenge of Changeable Customers

The Challenge of Changeable Customers

When it comes to behavioral targeting, I'm never surprised by the ads I'm served on my personal Mac.

Spoiled for Choice: Answers

Spoiled for Choice: Answers

Sterling Worldwide is hiring a new VP of sales and marketing. Should the CRM expert or the data person get the job? See what our readers has to say.

Peering Into the Marketing Future

Peering Into the Marketing Future

You've heard it many times before: The only constant is change. Not really. Sometimes, the only constant is stubborn resistance. This year we'll see a mix of both.