Everyone is talking about Big Data—and judging from my social streams and much of the media coverage, I’m afraid many don’t seem to have a clear understanding about what it is, or even if Big Data is in fact what they are dealing with.
The explosion of data has everyone thinking, “This must be a Big Data problem,” but sadly, a few million emails, a couple thousand social messages and a customer database isn’t Big Data. It may be a lot of data to manage and a headache, but how does the average CMO or chief technology officer build a strategy around handling their data if they’re prescribing it inaccurately?
Big Data is best defined by three dimensions: volume, velocity, and variety. It’s data in high volume that is continually generated with great speed and has lots of different types of datapoints within, be they structured, semi-structured, or unstructured. It’s generated out of sensors, games, mobile devices, set top boxes, social media sites, video players, and many other places.
The question for marketers is: What do you need to know and what can you do about it right now?
Identify, hypothesize, and analyze
First off, you have to understand if you even have a Big Data problem. If you don’t think you do, then you likely don’t. Big Data is visceral; it flows all around your business in ways that you can feel. A client recently told me he couldn’t get on top of his data because conversely it was on top of him—and this was after opening a relatively simplistic new source of approximately 600 million well-structured data records per month. Is there data around you that you intuitively feel you can use, but can’t get a handle on? If this is the case, you likely have a Big Data opportunity.
Once you’ve identified the opportunity, develop one or more hypotheses around the use and value of data. For example, I am continually amazed that marketers do not typically have access to the complete digital view of their customers. They are sending customers emails and posting on Facebook with links back to their core digital content—so why can’t we understand the complete path from the act of opening an email, to following links on a website, to an actual purchase, be it in-store or on the Web? It involves Big Data, generated out of the raw Web logs of your digital content.
Suppose you are a retailer that has 100,000 SKUs within your inventory at any point in time. What SKUs were in the email that caused the open and click behavior? Once on the website, where did that shopper go next and what other products or product class areas did they look at? What are the price points of the products viewed? Did that visit result in a conversion, and did it somehow relate to the initial SKU contained within the email? Or, was it the promotion (for example, free shipping) that caused the observed behavior? By collecting and analyzing this behavior across all of your emails, all of your subscribers, and all website visits, look to see if patterns of behavior emerge that you can leverage to drive new marketing and engagement tactics.
Keep ‘projects’ at bay
Now that you have one or more hypotheses to test, it’s time to take advantage of the rapidly emerging technologies that are out there. Just don’t turn it into a “project.” If you use your traditional go-to resources (see: internal IT), it’s likely that they will have neither the time nor expertise to test your hypothesis appropriately. In addition, traditional development cycles do not apply here. Even with a six month project cycle, the opportunity may be lost as a whole new set of merchandise, economic conditions, or new data sources arise. You therefore need to be able to test your hypothesis quickly and cost effectively.
If you can’t find the resources in-house, there are hundreds of emerging companies that provide both Big Data and Big Data analysis capabilities in the cloud as “software as a service” (SaaS). At this point you don’t need to understand all of the underlying technologies you are reading about. Simply know that they are useful for rapidly consolidating your Big Data into forms more accessible for analysis and hypothesis testing. Your choice of companies and methods are dictated by where you face bottlenecks. Do you have the analytic horsepower on your staff to work with the data?
Then find data mobilization experts. Do you have ready access to developers skilled in advanced scripting and data movement, but no statistical bandwidth? Then it’s time to move in a different direction. If you are severely constrained across many fronts, a broader full-service Big Data provider might be in order. The point is there are readily available outsourced resources to quickly test your hypothesis, provided you can get the data to them.
Lock and load
Once your Big Data hypothesis is tested and proven, you have the ammunition necessary to institutionalize your new process based on your marketing ROI. This institutionalization will involve a mix of internal and outsourced resources. But even before heading down this path, make sure you have the “small” data right.
Big Data is here to stay, providing a new task for the already challenged marketer to take on. But the promise of real ROI which moves the needle in consumer engagement is too great to ignore. Big Data allows us to take a broader view than the traditional “one campaign at a time” optimization, and it allows us to adapt quickly to underlying changes. Several key challenges facing retailers can be solved, such as promotion, offer, and price optimization, or even merchandise optimization to a specific store location.
The data is there, we just need to harness and use it to reap its rewards.
Bob Fetter is senior vice president of Pluris Marketing.
