This was posted at SearchEngineLand yesterday in case you missed it:
How often have you heard that Keyword level performance data can be misleading? That PPC managers need to consider the phases of the buying cycle when evaluating terms? That specific keywords tend to steal conversions from the more general keywords that started the customer's consideration?
It's pretty obvious why the engines trumpet this story: it makes them money. By convincing advertisers that they should spend money on general search terms regardless of the observed efficiency advertisers are encouraged to spend without the moorings associated with ROI goals. Is it surprising that Google's quarterly profits were strong in spite of the fact that most advertisers are struggling?
Google and Compete Inc. presented a study of this subject that managed to answer none of the salient questions.
We presented a study almost 3 years ago at SES that challenged the notion of the buying cycle, but decided it was time to revisit the topic.
First, we grabbed data from a number of retail clients representing different verticals and different business models (pure plays, catalogers, brick and mortar retail, etc). We then sought to answer the questions:
- How often are multiple ads touched prior to an order?
- Does the interaction happen the way they say it does?
- Do these data suggest that crediting the first touch or the last touch or some smeared credit allocation would be closer to the truth? and finally,
- Do the different types of retail businesses witness different behaviors?
First, let's talk about cookie windows. The longer window of time you allow the greater this effect appears to be. But for a retailer, unless your AOV is huge, you need to place some "make sense" limits on how long to give credit to an ad. Most of our clients have windows of 14 to 30 days with some shorter and some longer depending on what the data suggests. Out of respect for the argument that there is this long consideration cycle, I went ahead and looked at a 45 day window for these clients.
Then, recognize that we're only really interested in orders with more than one different non-brand keyword involved. We define "brand" as the retailer's trademark and variants exclusively, hence "Sony Walkman" is a non-brand phrase for Best Buy, but a brand phrase for Sony.com. For well known retailers there is a 4% - 8% impact of non-brand clicks being followed by brand clicks as customers remember that they found the perfect ring at Zales. We count these as non-brand orders, and uninteresting for this purpose unless there was more than one non-brand keyword involved.
With those parameters understood, we found that interesting cases of multiple non-brand keyword touches occurred in between 10% and 15% of the orders for the vast majority of retailers. A few higher, a few lower. That's not zero, but it's not earth-shattering either.
More interesting: when we spent some time studying the impacted orders we found that in only about 35% of the cases did the story play out as advertised, with general searches being followed by more specific searches; in about 15% of the cases the other keywords were simply slight variations on the initial search (eg: "VCR sales" and "Buy VCR", or "Nikon lens" and "Nikon lenses") and in 50% of the cases the initial keyword had no relationship whatsoever to the last keyword prior to the order (eg "loveseat slipcovers" and "gold earrings").
The more we extend the cookie window the greater the propensity for the keywords to be unrelated, indicating that, in fact these were separate shopping events, and that person looking for loveseat slipcovers, bought from someone else :-( Our research on what the person actually purchased was anecdotal, we just tested 15 or 20 samples and found that in each case the order related to the last keyword, not the first.
Those sites that appeal to hobby enthusiasts see more multi-touch interactions than general retailers. Indeed, the impacts of AOV, business type and vertical were all quite interesting.
To our thinking this confirms several tenets of Search Marketing strategy:
- The engines are not evil, but neither should they be expected to look out for your interests;
- Cookie Windows matter and should be carefully considered.
- Within Paid Search, "last click" credit schemes seem to be a better proxy for the truth than either "first click" or "shared credit"
- If Keyword level performance data suggests a keyword is underperforming, it probably is.
Researching your own search data is a valuable exercise. It may help you determine whether the Buying Cycle should impact your keyword efficiency targets, or whether, for you, it's much ado about nothing.
See for yourself!