RKG Logo 434-970-1010

Two excellent posts last week about incrementality and matchbacks.

Here’s the gist of matchbacks: if customer gets your marketing message and then orders, the marketing message was responsible for the order. Logical, yes?

No. To establish incrementality, you need a holdout cell to find out the fraction of similar prospects who would ordered anyway. The benefit of the campaign is the sales lift between recipients and control, not total sales to the control.

Here’s Jim Novo talking incrementality at HSN. (Read the whole post to learn the equivalent of SEO for DRTV.)

When the campaigns included coupons, the redemptions were absolutely huge. That’s good, right? Well, in a word, No. Think about it. There was barely any lift in sales at all, yet huge numbers of coupons were redeemed. Meaning?

This means that virtually all the coupons were redeemed by current customers, and the coupon / response did not change their behavior. They bought at the same rate as they would have without the coupon. It means we gave a ton of margin away in addition to the cost of the Campaign, and generated no increase in Sales. We literally would have been better off (financially) by doing absolutely nothing.
–Jim Novo, Marketing Productivity Blog

Here’s Kevin Hillstrom giving a hypothetical from the recent election.

Traditional multichannel marketing was proven as viable via the matchback algorithm. Folks would mail 26 catalogs a year, then take credit for all of the online and retail orders from customers receiving the catalogs.

Mail and holdout tests seldom defend this style of analysis and attribution.

Try this one on, for size. If we believe that matchback analytics are accurate, then the Democratic Party could have sent 60,000,000 postcards to prospective Democratic voters two weeks before the Presidential Election — and then matched each vote back to the postcard. The Democratic party could prove, via matchback analytics, that the postcard was responsible for the election results, right?!
– Kevin Hillstrom, MineThatData

In these challenging economic times, with an abundance of overlapping marketing messages and rampant discounting, campaigns need to show incremental lift, not just sales.

Technorati Tags: , , , , , , , , , , ,

If you like this post, consider subscribing to our RSS feed. You can also have new posts sent to you via email.


Related Posts

    No related posts.

Your Comment

Trackback

http://www.rimmkaufman.com/rkgblog/2009/01/29/marketing-campaigns-must-show-incremental-lift-not-just-sales/trackback/

Blogs Citing This Post

  1. Pingback: Web Technology » Blog Archive » SearchCap: The Day In Search, January 29, 2009 on February 9, 2009
  2. Pingback: Seven Essential Metrics to Present and Communicate Success | Optify on May 13, 2010

Email Updates

Categories

Recent Comments

  • George Michie: Art, your observations about negatives are very interesting. Hopeful the selection bias will get people to read before they click,...
  • George Michie: John E., thanks for stopping by! You make an excellent point over as SEL, but I think what will happen is a positive selection bias....
  • John: I too am concerned about the long tail effect. Users are going to have to “wade” through competing websites to find anything...
  • John Ellis: As a paid search marketer, I am little concerned about the long-tail effect. Hopefully, I am wrong. FYI – See my thoughts here:...
  • Jc: Yeah when you’re talking about Google, they already have a large set of randomly sampled statistics on user behavior from their tests...
  • Art: Here are some observations I have so far. 1. Example: In my daycare campaign I have “jobs” as a negative phrase match keyword. When I do a...
  • George Michie: Dale, it will be fascinating to see how this plays out. I have to believe that it won’t result in a greater propensity for...
  • George Michie: Another interesting possibility: If users no longer scroll, but “just keep typing” does that mean that the click volume...
  • Dale Stokdyk: For me, it’s hard to believe the 3 second rule is enough — in my gut, I suspect impressions will increase. Also, I...
  • George Michie: Great point, JC, They made the comment during the press conference that they think* users will conduct more searches around the...
  • Jc: I think it will be very interesting what will happen to impressions and CTR. Based on the assumption that whatever Google does increases their...
  • George Michie: Dale it’s a great question. I wonder what fraction of searches actually happen from Google.com vs toolbars vs an iGoogle...
  • Dale Stokdyk: George, I use the Google Search Bar 99% of the time — I wonder about others? Was fascinating to watch the search results change...
  • George Michie: :-) Somewhat less so…Yahoo?…don̵ 7;t get me started :-)
  • Jc: Now my question is, do you share the same level of faith about Bing? Haha.

Blog Stats

  • Posts: 993
  • Words: 481,930
  • Comments: 3,390

Administration