The analytics community has never had a sufficiently robust set of data that captures creative impact on business results. In ABX testing of 250,000 ads across 18 industries, we found that creative is the largest contributor by far at 50--60% of sales lift. Without creative data factored in, it’s no wonder that correlating Ad Spend to business outcomes becomes very difficult.
At present, insights directors and marketers use media spend data as inputs into their marketing mix models. However, the question John Wanamaker asks can't be easily answered because Ad Spend doesn’t account for the variability of creative. Some ads are effective, but at least fifty to sixty percent are not. Also, an accurate Return on Ad Spend or ROAS can’t be produced from the small portion of one’s advertising that has been through pretesting.
Thus, for advertisers to see the results of a campaign in the language of management, they need to put ALL their advertising through creative testing, which can be done today affordably. The creative scores are then married to Ad Spend and the Market Mix Models snap into place. See the great case studies below, and then see definitions for Return on Ad Spend (ROAS), ROI, Predictive Analytics and Marketing Mix Models.
This study compares the effects of the media portion of Advertising Spend versus creative testing scores on sales revenues for one of the world’s largest cosmetic brands. ABX provided a robust set of advertising effectiveness measurement scores for client ads across all media types over a period of 30 months, which were integrated into the marketing mix model. Insights included:
Second, in an ideal world, media spend on an ad by ad basis would align perfectly with ad sales lift, but this is not the case in this study nor in the real world. As we see below, the correlation between the quantitative ad spend-per-spot and sales lift had a very low correlation of r²=.1138. When we married creative testing scores as a qualitative measure to the media spend, the correlations soar to r²=.743.
If creative isn’t good, media buys are virtually wasted. As mentioned above, had the client used creative scores to allocate media budget, it could have generated an incremental +$26 million in revenue. Creative effectiveness drives sales whereas ad spend is a much weaker driver. (Courtesy Bottom-Line Analytics).
A similar approach was taken with one of the top carbonated beverages in the world. The marketing mix modelers weighted the media spend with creative testing data and compared it to sales revenues over a three-year period. A high correlation of 71.2% showed the weighted creative scores did very well against sales. (Courtesy Bottom-Line Analytics).
A large state lottery’s average creative score index over the past year was 91, which was short of the 100 “average” in advertising effectiveness. This case was particularly interesting because the marketing mix modelers showed how much sales revenues could increase as creative testing scores went up. (Courtesy Bottom-Line Analytics) Amazingly, for every single data point increase in the Florida Lottery average ad effectiveness score, the incremental revenue would be $715,000. This is predictive analytics as its best. In the chart below, as the Copy Score weighted average increases (horizontally), the incremental sales revenues also increase (vertically). The creative team has a great deal of power to positively affect sales results.
Before jumping into the case studies, it usually helps to take a quick look at commonly-used measurement terms that management is likely asking for. The first, ROAS, is heavily searched today, which means it has become popular currency for estimating success.
effectiveness. It can be calculated for online and offline media campaigns. Calculating the ROAS allows online marketers to see whether their advertising budget generates sufficient revenue. To calculate ROAS, take the revenue generated by a campaign or ad source and divide it by its media expenses. A ROAS higher than one means that the campaign is generating more revenue than expenses. Of course, everyone knows and uses the term “ROI.” However, ROI was really built as a measurement of an entire operation or business. It can be used at a smaller level, such as for a marketing or advertising department. But to do it right, one must factor in every cost - personnel, real estate, lights, computers. etc.
Whether management is looking at ROAS, ROI or Predictive Analytics through marketing mix modeling, none will tell an accurate story of success without creative being included since it accounts for 60% on average of advertising success.
