QwestDex Accelerates Data Processing System

Share this content:
Online direct marketing firm QwestDex Direct called in information manager Applied Semantics to help organize a 2.3 million-entry expansion to its business-to-business database in two weeks, saving weeks of data processing time.

In a case study, QwestDex said that its use of Applied Semantics' automated categorization system helped classify the new data into 4,500 categories. QwestDex's DotComDirectory.com business unit keeps a database of online businesses, numbering in the millions, that QwestDex customers use for direct marketing. Records are grouped into categories so clients can easily select which segment of the database they wish to target.

Adding records to the database can be challenging because of the need to place each record into a specific category. Manual organization of the new data would have taken years, the company estimated.

Database-management systems exist that can group the data automatically. These "learning by example" systems use manually inputted sample records to build a model for each category, and group the data based on similarity to the models.

However, such systems typically need at least 50 records inputted per category, and sometimes need as many as 200 for high accuracy, said Gil Elbaz, acting CEO of Applied Semantics. Even using 50 samples, QwestDex would have had to input 225,000 records manually for such a categorization system to work, nearly 10 percent of the whole database.

Applied Semantics estimated such a task would have required 470 person-days of labor. However, in early discussion with its future client, Applied Semantics told QwestDex it could do the job in two weeks.

Applied Semantics' method differs in that it does not require manual inputting of sample records. Its system has a database of words and terms grouped into 500,000 "concept sets" or categories that can be used to draw similarities between records.

The system is organized something like a thesaurus, with an entry for each word containing dozens of synonyms. The database of terms contains 1.5 million entries and uses two gigabytes of memory.

Applied Semantics lexicographers matched the 4,500 categories in the QwestDex database with their appropriate concept sets, thus showing the categorization system which terms to look for when grouping records into categories.

Processing time took four days. Checking and authenticating the data after they had been categorized took the rest of the two weeks.


Next Article in Data/Analytics

Sign up to our newsletters

Company of the Week

We recently were named B2B Magazine's Direct Marketing Agency of the Year, and with good reason: We make real, measureable, positive change happen for our clients. A full-service agency founded in 1974, Bader Rutter expertly helps you get the right message to the right audience at the right time through the right channels. As we engage our clients' audiences along their journey, direct marketing (email, direct mail, phone, SMS) and behavioral marketing (SEM, retargeting, contextual) channels deliver information relevant to the needs of each stage. We are experts at implementing and leveraging marketing technologies such as CRM and marketing automation in order to synchronize sales and marketing communications. Our team of architects and activators plan, execute, measure and adjust in real time to ensure the strategy is working as needed and change things if it's not.

Find out more here »

Career Center

Check out hundreds of exciting professional opportunities available on DMN's Career Center.  
Explore careers in digital marketing, sales, eCommerce, marketing communications, IT, data strategies, and much more. And don't forget to update your resume so employers can contact you privately about job opportunities.

>>Click Here

Relive the 2017 Marketing Hall of Femme

Click the image above