Sheer volume of data requires a move beyond relational databases

Share this content:

Relational databases — matching data by using common characteristics to better understand them — won the hearts and budgets of marketing departments in the 1990s. Today, a relational data store is part of the core requirements of nearly every RFP that we receive. Relational data has limitations in multichannel marketing, but technology is progressing to fill the gap.

Over the years, marketers have realized that relational databases don't satisfy every marketing requirement. The very size of certain data sets makes using relational databases less feasible than in the past. Information created in website logs, search, social networking and mobile applications dwarfs the transactional or demographic data in most marketing databases. Where a large bank's customer accounts will number in the many millions, a social site such as Facebook will have hundreds of millions of accounts. Google handles hundreds of millions of searches per day. Traditional businesses, such as grocery retailing, can rapidly generate large databases, due to the high number of customers, items sold and transactions.

With such data sets, relational databases are not really feasible, even with the many performance improvements that relational vendors have implemented over the years. The open-source community has responded and is quickly moving into the picture.

One of the current buzzwords in database circles is the so-called NoSQL movement, a loose term for a whole collection of technologies designed to handle large data sets, often in a highly distributed environment. For example, one solution works by distributing data across hardware nodes using a distributed file system. Queries are handled by each node in the cluster, permitting queries to be processed in parallel before results are consolidated.

The race is on amongst both commercial solutions providers, such as Netezza, and open source teams, like Apache Cassandra, to fill the void relational databases leave. While non-relational database solutions' effectiveness now vary widely by cost, ease of use, upfront effort, scaling and query construction, these technologies will move from being rather esoteric to becoming more mainstream within the next few years.

For those who already find that even well-designed databases are beginning to get bogged down by too much data, the answer may not be simply throwing more hardware at the problem. There are good options available today that can crunch data faster and turn the resulting insights into more effective marketing, and might keep you from falling behind your competition.

David King is CEO of Fulcrum, a database marketing firm based in New York City.


Next Article in Data/Analytics

Sign up to our newsletters

Company of the Week

We recently were named B2B Magazine's Direct Marketing Agency of the Year, and with good reason: We make real, measureable, positive change happen for our clients. A full-service agency founded in 1974, Bader Rutter expertly helps you get the right message to the right audience at the right time through the right channels. As we engage our clients' audiences along their journey, direct marketing (email, direct mail, phone, SMS) and behavioral marketing (SEM, retargeting, contextual) channels deliver information relevant to the needs of each stage. We are experts at implementing and leveraging marketing technologies such as CRM and marketing automation in order to synchronize sales and marketing communications. Our team of architects and activators plan, execute, measure and adjust in real time to ensure the strategy is working as needed and change things if it's not.

Find out more here »

Career Center

Check out hundreds of exciting professional opportunities available on DMN's Career Center.  
Explore careers in digital marketing, sales, eCommerce, marketing communications, IT, data strategies, and much more. And don't forget to update your resume so employers can contact you privately about job opportunities.

>>Click Here

Relive the 2017 Marketing Hall of Femme

Click the image above