RKG Logo 434-978-4300

Two excellent posts last week about incrementality and matchbacks.

Here’s the gist of matchbacks: if customer gets your marketing message and then orders, the marketing message was responsible for the order. Logical, yes?

No. To establish incrementality, you need a holdout cell to find out the fraction of similar prospects who would ordered anyway. The benefit of the campaign is the sales lift between recipients and control, not total sales to the control.

Here’s Jim Novo talking incrementality at HSN. (Read the whole post to learn the equivalent of SEO for DRTV.)

When the campaigns included coupons, the redemptions were absolutely huge. That’s good, right? Well, in a word, No. Think about it. There was barely any lift in sales at all, yet huge numbers of coupons were redeemed. Meaning?

This means that virtually all the coupons were redeemed by current customers, and the coupon / response did not change their behavior. They bought at the same rate as they would have without the coupon. It means we gave a ton of margin away in addition to the cost of the Campaign, and generated no increase in Sales. We literally would have been better off (financially) by doing absolutely nothing.
–Jim Novo, Marketing Productivity Blog

Here’s Kevin Hillstrom giving a hypothetical from the recent election.

Traditional multichannel marketing was proven as viable via the matchback algorithm. Folks would mail 26 catalogs a year, then take credit for all of the online and retail orders from customers receiving the catalogs.

Mail and holdout tests seldom defend this style of analysis and attribution.

Try this one on, for size. If we believe that matchback analytics are accurate, then the Democratic Party could have sent 60,000,000 postcards to prospective Democratic voters two weeks before the Presidential Election — and then matched each vote back to the postcard. The Democratic party could prove, via matchback analytics, that the postcard was responsible for the election results, right?!
– Kevin Hillstrom, MineThatData

In these challenging economic times, with an abundance of overlapping marketing messages and rampant discounting, campaigns need to show incremental lift, not just sales.

If you like this post, consider subscribing to our RSS feed. You can also have new posts sent to you via email.


Related Posts

Your Comment

Trackback

http://www.rimmkaufman.com/rkgblog/2009/01/29/marketing-campaigns-must-show-incremental-lift-not-just-sales/trackback/

Blogs Citing This Post

  1. Pingback: Web Technology » Blog Archive » SearchCap: The Day In Search, January 29, 2009 on February 9, 2009

Email Updates

Categories

Recent Comments

  • Curtis: Great study George! Along the same lines, I’m trying to find a study about which search engines have the highest conversion ratios....
  • registry cleaner: Thank you. I found your division of total time spent on priorities very useful!thanks again
  • George Michie: Ophir, thank you for your marvelous comment. I agree with you. Brand building is an important element of marketing, and a very...
  • Ophir: Hi George, Interesting post, very intereting. I find myself struggling with this issue day in day out and I mostly agreee with your...
  • Kevin Hillstrom: Oh, you are on to something! I can promise you that.
  • George Michie: I am eager to see what you’re thinking on the topic, Kevin. Some of our early early data scratchings suggest that we may be...
  • Kevin Hillstrom: This will teach me to not schedule posts … I have a half-dozen similar posts coming in the next week!!
  • TAMMY LANGWORTHY: I WISH TO CANCEL MY FUN FAMILY REWARDS AS I DON’T USE IT VERY MUCH. THANK YOU TAMMY LANGWORTHY
  • George Michie: Thanks Dave, it is a hot topic for good reason. I’ve had some interesting conversations with Kevin Hillstrom about his...
  • Mark Ballard: I certainly don’t mean to discourage advertising with Yahoo at all as there’s plenty of value to be had there. Healthy...
  • Nathan L.: I have thought about advertising on Yahoo! for some time, but news like this makes me want to just stick with Google. Good useful...
  • Dave 2.0: George, thanks for the callout on the survey. I’m VERY interested in the topic.
  • Nancy Maiewski: Another charge on my J.C.Penney statement for $9.95 for Family Fun Rewards! This isn’t the first time I have opened my bill...
  • George Michie: David, I’m sure Shop.org will make the results available to participants. We’re talking about presenting them at the...
  • David: It’s not clear from the survey whether participants get a free copy of the results. Do you know?

Blog Stats

  • Posts: 938
  • Words: 441,342
  • Comments: 2,755

Administration