Study Claims Marketers Who Neglect A/B Split Testing Are Losing Millions

Share this content:
Online marketers routinely leave large amounts of money on the table every time they launch Web and/or e-mail marketing programs because they rely on intuition instead of empirical testing.

That's the essence of the research found in the A/B Split Testing research brief issued yesterday by, Atlantic Beach, FL.

"Many of the best marketers in the world rely exclusively on their instincts," said Flint McGlaughlin, director of MEC Labs and editor of the online research journal, said in a statement. "Unfortunately, those instincts are often wrong."

The MEC Labs research brief, called "A/B Split Testing," found that some companies are losing millions of dollars by not testing new marketing campaigns, McGlaughlin said.

The research brief is currently available for free in The Marketing Experiments Journal (

A/B split testing evaluates the impact of a Web page, e-mail, letter or other promotional material by creating two or more alternatives of a specific message or product to determine which is more successful in maximizing conversion, click-through, sales completion or other measurable objectives.

Incoming traffic among the multiple versions is divided equally. Customers' behaviors, as seen through key performance metrics, are tracked to determine which version works the best.

This process may be repeated over and over until optimum performance is achieved, or a diminishing returns threshold is reached.

The research brief outlines three specific A/B split tests conducted by MEC and examines how the findings can be used to create more effective promotional materials. The results also show that the outcome of one test will tend to inspire questions that stimulate further testing and result in the best possible marketing efforts and materials.

In addition to its empirical findings, MEC's research brief also discusses proper testing protocol to help beginners get started with A/B split testing within their organizations.

"We all know businesses rely on effective marketing strategies to achieve long term success," McGlaughlin said. "That's why it is so imperative that promotional materials get the messaging right, and we know that the way to do this is through repeated testing. This is why our consistent message to marketing professionals is: Take the time to research and test. It is worth it."

Sign up to our newsletters

Company of the Week

Since 1985, Melissa has helped thousands of companies clean, correct and complete contact data to better target and communicate with their customers. We offer a full spectrum of data quality solutions, including global address, phone, email, and name validation, identify verification - available for batch or real-time processes, in the Cloud or on-premise. Our service bureau provides dedupe, email/phone append and geographic/demographic append services for better targeting and insight. For direct mailers, Melissa offers easy-to-use address management/postal software, list hygiene services and 100s of specialty mailing lists - all with competitive pricing and excellent customer service.

Find out more here »

Career Center

Check out hundreds of exciting professional opportunities available on DMN's Career Center.  
Explore careers in digital marketing, sales, eCommerce, marketing communications, IT, data strategies, and much more. And don't forget to update your resume so employers can contact you privately about job opportunities.

>>Click Here

Relive the 2017 Marketing Hall of Femme

Click the image above