Learn
Learn
Close

They Ask, You Answer

A revolutionary approach to inbound sales, content marketing, and today’s digital consumer.

Learn MoreLearn More

Free Courses in IMPACT+

Dozens of sales, marketing, and content courses inside IMPACT+. Start learning now.

See all coursesSee all courses
Events
Events
Close
IMPACT+ Membership
IMPACT+ Membership
Close
Coaching & Implementation Services
Coaching & Implementation Services
Close

Services Overview

See how you can dramatically increase your inbound leads and sales.

Services Overview

Digital Sales and Marketing Mastery

Fast track your team’s success with IMPACT's most popular service.

Digital Sales and Marketing Mastery

Web Design

Launch a beautiful website that consistently generates leads and revenue.

Web Design

Virtual Sales Training

Equip your sales team with comprehensive training designed to help them close more deals in today's virtual-first world.

Virtual Sales Training

HubSpot Training & Implementation

Train your company to take ownership of HubSpot and get the most out of your investment.

HubSpot Training & Implementation

Case Studies

See dozens of examples of companies succeeding with Digital Sales and Marketing Mastery and They Ask, You Answer.

Case Studies
Become a Coach
Become a Coach
Close

Does Your Creative Really Work? New Machine-Learning Knows For Sure.

Does Your Creative Really Work? New Machine-Learning Knows For Sure. Blog Feature

Eric Choma

Controller, 8+ Years of Diverse Accounting Experience & Consulting

October 24th, 2018 min read

How important is creative in marketing and advertising?

Answers may vary based on who you ask, but I’m sure few would just shrug it off.

Based on a recent Nielsen Study, creative can be responsible for up to 47% of sales increases attributed to advertising, however, people have tended to neglect analytics related to digital creative, leaving us to rely on irrelevant response metrics like click-through rates.

Flashtalking has addressed this problem by creating a new, machine learning-based approach to evaluating the performance of yours, whether it be written, video, design, etc.

Using a multi-touch attribution engine to score the contribution of each impression, they applied an additional layer of data science to control for media and audience bias in the data.

This results in an understanding of the creative impact for each delivered ad, based on its ability to influence behavioral outcomes (tracked success events).

Over the last year, over 24 brands have used these approach to analyze over 60+ campaigns covering the Travel, Media, Telco, Gaming, Consumer Services, and Energy sectors (averaging 142M impressions per campaign).

A conversion, like in inbound marketing, was defined as either a purchase or an indication of intent to purchase.

Why Should You Care?


By assessing the results of these campaigns, Flashtalking uncovered that a few important things worth noting:

Creative Performance Varies - A LOT


On average, the top performing quartile of creative is 7X MORE IMPACTFUL than the worst performing quartile of creative. Even in the narrowest case, the top quartile creative was 80% more impactful than those in the bottom performance quartile.

Click-through Rates (CTR) Are Horrible Metrics

CTR and creative performance are NEGATIVELY correlated.

“Creatives in the top quartile had an average CTR that was less than half of those in the bottom (.007% vs. .017%),” the report found, adding, “As the chart shows, CTR for the top quartile was almost always lower. In cases where they did have a higher CTR, the difference was usually quite small---supporting the thesis that CTR and creative performance are negatively correlated.”

marketing-creative-performance-metrics

So, What Are Actually GOOD Creative Metrics?

The results paint a pretty convincing picture for marketers.

The significant variances in performance across creative indicate there’s a huge opportunity for marketers to improve how they measure and optimize their creative.

Good creative metrics achieve the following:

Reflect actual conversion impact:

Your metrics must consider the actual impact that your creative has on a user’s likelihood to convert. This means the metric cannot:

  • Rely solely on proxy metrics such as engagement rates. (a.k.a. vanity metrics like “likes” or “follows")

  • Allocate credit in a way that is arbitrary or inaccurate (e.g. only assigning credit to the click or first/last impression)

Are free from bias:

There are two major sources of bias in creative measurement and both must be addressed when analyzing creative performance.

  • Bias due to placement. For example, a video distributed in a relevant, targeted, and visible way is much more likely to have an impact than one served broadly at the bottom of a crowded, irrelevant page.

  • Bias due to the audience. Ads served to regular site visitors and/or brand advocates (and even those in the retargeting segment) are more likely to elicit a response than those served to users who are not fans of the brand, regardless of the quality of the creative.

Represent a significant sample size:

Many analytic techniques are great in theory but are not practical due to limitations on campaign size and time-frames for collecting data. A good metric needs to work with real-world (often small) sample sizes, while still allowing for granular comparisons of creative.

Finding the Right Creative Metric for You

Effective creative optimization may be one of the few untapped competitive advantages for marketers and advertisers. So what can (and should) marketers do?

The tools to accurately measure creative performance do exist, either as off-the-shelf solutions or as in-house solutions, but tracking the right metrics is only the first step.

Marketers will also need to implement processes that place creative performance optimization at the forefront, elevate its priority to receive the same level of attention, and analytic rigor as that of media and audience analysis.

How are you currently measuring your creative performance? How effective has it been? Let us know in IMPACT Elite!

Want to learn more about digital sales and marketing?

Master digital sales and marketing when you join IMPACT+ for FREE. Gain instant access to exclusive courses and keynotes taught by Marcus Sheridan, Brian Halligan, Liz Moorehead, Ann Handley, David Cancel, Carina Duffy, Zach Basner, and more.

Sign up for free
Take a peek

Access hundreds of FREE courses and keynotes

Free Course
Digital Sales & Marketing Framework for Today’s Buyers
By: Marcus Sheridan
View Course Preview View Course Preview
Free Keynote
A New Way to Compete & Win
By: Brian Halligan
View Course Preview View Course Preview
Free Virtual Keynote
How To Genuinely Feel Confident, Be Likable, And Build Trust On Camera
By: Liz Moorehead
View Course Preview View Course Preview
Free Keynote
The Future of Marketing is Conversational​
By: David Cancel
View Course Preview View Course Preview
Free Deep Dive
HubSpot On a Budget: Getting Started with HubSpot Starter Hubs
By: Courtney Caldwell
View Course Preview View Course Preview
Free Course
Assignment Selling: Content is Your Greatest Sales Tool
By: Marcus Sheridan
View Course Preview View Course Preview
Free Keynote
The Big, Bold, Brave New World of Marketing​
By: Ann Handley
View Course Preview View Course Preview
Free Course
Investing in Incredible Digital Sales and Marketing Results
By: Chris Duprey
View Course Preview View Course Preview
Free Course
How To Show Your Content Makes Money With HubSpot Marketing and Sales Hubs
By: Liz Moorehead
View Course Preview View Course Preview
Free Virtual Keynote
The Visual Sale
By: Marcus Sheridan & Tyler Lessard
View Course Preview View Course Preview
Free Keynote
Marketing Tech: What’s Now, What’s Near and What’s Not Anytime Soon?​
By: Dharmesh Shah
View Course Preview View Course Preview
Free Course
Inbound Lead Generation & Conversion Optimization
By: Carina Duffy
View Course Preview View Course Preview
Free Virtual Keynote
Fundamentals of Videography: You Can Be a Great Videographer Too
By: Zach Basner
View Course Preview View Course Preview
Free Deep Dive
The Ultimate Customer Service Toolkit for Any Budget
By: Andriti Gulati
View Course Preview View Course Preview
Free Course
6 Topics Subject Matter Experts Need to Address
By: Kevin Phillips
View Course Preview View Course Preview
Free Keynote
Fanocracy: The Power of Making Business Personal​
By: David Meerman Scott
View Course Preview View Course Preview
Free Keynote
The Power of Pillar Content
By: Liz Moorehead
View Course Preview View Course Preview
Free Keynote
SEO for the Future
By: Franco Valentino
View Course Preview View Course Preview
Free Course
Fundamentals of Social Media Marketing
By: Stephanie Baiocchi
View Course Preview View Course Preview
Free Deep Dive
A Practical Guide To Video Graphics
By: Colton Trcic
View Course Preview View Course Preview
Free Session
How To Get Your Community To Know, Like, And Trust You With Video
By: Marki Lemons Rhyal
View Course Preview View Course Preview
Free Course
Video Sales and Marketing Strategy
By: Zach Basner
View Course Preview View Course Preview
Here Are Some Related Articles You May Find Interesting

Want to Contribute Content to impactplus.com? Click Here.

IMPACT+ Sign Up
A FREE online learning community with on-demand courses, hundreds of expert-led sessions, thousands of your peers ready to support you, and much more.
Check it out
Hundreds of courses and recorded keynotes, completely FREE
Check it out
Access hundreds of digital sales and marketing courses and recorded keynotes, completely FREE