Cloverleaf Tracks In-Store Feelings

Share this content:

The retail technology vendor is moving beyond the paper shelf tags

Imagine: You're walking down the beverage aisle at your local convenience store when you notice carbonated bubbles formulating across the digital display at the shelf. The movement and colors attract your attention, so you move closer to the shelf to investigate. As you do, different types of cola cans from the brand featured on the shelf (e.g. diet cola, cherry cola) appear across the screen along with the brand's marketing message. You reach for a 12 pack on the shelf and see the display content change again—this time alerting you that you can buy two packs for $10.

This is the picture Jan Murley, chief strategy and market advisor to Cloverleaf, painted when describing the retail technology company's newest solution: shelfPoint.

ShelfPoint is a dynamic shelf solution that marries in-store consumer behavior with emotional intelligence to help marketers push content to shoppers and learn more about them. ShelfPoint uses an on-shelf, digital LCD strip as the platform and user interface, Murley says, and leverages a media player to serve content based on shoppers' movements, which it can track through optical sensors.

The triggered content is designed to get shoppers to do three things, she notes: Stop, engage, and convert. She explains that Cloverleaf measures conversion by comparing shelfPoint's traffic count to the retailer's point-of-sale data.

In addition to engaging and converting shoppers, the platform is designed to help marketers learn more about them. Leveraging optical sensors, shelfPoint gathers anonymous demographic data, such as gender and ethnicity. The sensors can also track customers' facial expressions and, through a partnership with emotional artificial intelligence company Affectiva, classify them to analyze sentiment.

However, Murley is quick to point out that shelfPoint does not take pictures of customers or store any personal information. When shelfPoint detects a shopper, it pixelates the image and then sends the metadata to a cloud where the data is matched to a facial template. This data is then stored for only 24 hours.

“We're very concerned about the security and the privacy of all of those individuals,” she says.

Seth Grimes, president of natural language processing and sentiment analysis consultancy Alta Plana, notes that emotional intelligence is something that's been around for years; however, people are now leveraging machines to decipher human feelings and perceptions.

“We're trying to computerize everything,” he says, including sentiment analysis for humans' facial expressions, product reviews, and social content.

From Murley's perspective, emotional intelligence opens the door for more "honest" feedback — arguing that consumers sometimes say what they think marketers want them to when asked for feedback.

However, Grimes doesn't agree. He considers unsolicited social media posts and product reviews “genuine expressions” and says that facial recognition's effectiveness can be offset depending on whether it's conducted in a lab setting or “in the wild.” He also says that marketers can run into a bias issue if they don't give their facial recognition technology enough time to recognize people who fall outside of the category parameters it's been trained to identify.

“Technology can do a lot of things,” he says. “But if you don't understand the ‘gotchas''re going to fall into traps.”

Photo source: Cloverleaf


Next Article in Marketing Automation

Sign up to our newsletters

Company of the Week

USAData helps businesses find new customers and grow their current customers through a combination of data and digital marketing services, and easy-to-use SaaS technology products. We enrich customer data so businesses can more effectively target and communicate with customers, and connect them with their best look-alike prospects through digital and traditional channels. We make it easy through simple, self-serve applications and APIs, as well as through full-service programs managed by our Data and Digital experts. 

Find out more here »

Career Center

Check out hundreds of exciting professional opportunities available on DMN's Career Center.  
Explore careers in digital marketing, sales, eCommerce, marketing communications, IT, data strategies, and much more. And don't forget to update your resume so employers can contact you privately about job opportunities.

>>Click Here

Relive the 2017 Marketing Hall of Femme

Click the image above