Letter: How Many Pieces Should You Mail?

Share this article:
In his Creative Checklist column, Dean Rieck warns about making decisions based on insignificant results, but doesn't say how many pieces you have to mail to get a statistically valid test.


Ed McLean addressed this topic decades ago in his classic monograph, "The Basics of Testing." In it, he included a table to help the reader determine the minimum acceptable test cell size.


The table shows that to mail with an 85 percent confidence level that your rollout results won't decline more than 25 percent of the test figure, you must mail enough to collect 14 responses. If your response rate is 1 percent, that means each test cell must have 1,400 pieces.


Bob Bly, Copywriter/consultant,Dumont, NJ,


rwbly@bly.com



Share this article:

Sign up to our newsletters

Follow us on Twitter @dmnews

Latest Jobs:

More in Opinions

The One-to-One Future Is Now

The One-to-One Future Is Now

Editor-in-Chief Ginger Conlon offers her take on what it means to make an impact on the marketing industry.

Leading by (Poor) Example: Answers

Leading by (Poor) Example: Answers

The VP of marketing has been a little lax in his definition of the term "business expense" and it shows. See how our readers would handle this thorny situation.

Attention Marketing Consultants: Protect Yourselves

Attention Marketing Consultants: Protect Yourselves

A lot can go wrong when you're a marketing consultant—but there are plenty of ways to safeguard yourself if you're smart about it.