Learn
Learn
Close

They Ask, You Answer

A revolutionary approach to inbound sales, content marketing, and today’s digital consumer.

Learn MoreLearn More

Free Courses in IMPACT+

Dozens of sales, marketing, and content courses inside IMPACT+. Start learning now.

See all coursesSee all courses
Events
Events
Close
IMPACT+ Membership
IMPACT+ Membership
Close
Coaching & Implementation Services
Coaching & Implementation Services
Close

Services Overview

See how you can dramatically increase your inbound leads and sales.

Services Overview

Digital Sales and Marketing Mastery

Fast track your team’s success with IMPACT's most popular service.

Digital Sales and Marketing Mastery

Web Design

Launch a beautiful website that consistently generates leads and revenue.

Web Design

Virtual Sales Training

Equip your sales team with comprehensive training designed to help them close more deals in today's virtual-first world.

Virtual Sales Training

HubSpot Training & Implementation

Train your company to take ownership of HubSpot and get the most out of your investment.

HubSpot Training & Implementation

Case Studies

See dozens of examples of companies succeeding with Digital Sales and Marketing Mastery and They Ask, You Answer.

Case Studies
Become a Coach
Become a Coach
Close
Straight Up vs Sexy: Testing Email Subject Lines Blog Feature

October 16th, 2014 min read

Testing Email Subject LinesIf you ask a marketer what goes into a great email subject line, it's likely that you'll get a dozen different answers.

If you Google it, you'll be met with several dozen more. 

Now what? 

With so much riding on the performance of an email's subject line, we took matters into our own hands and conducted an A/B test comparing two different subject lines promoting the same offer. 

The results are in and we're ready to walk you through it. Let's go.

Here's what the A/B test looked like:

Variation A: The Newly-Updated Beginner's Guide to Inbound Marketing

 

Screen_Shot_2014-10-15_at_10.24.29_AM.png

 

Variation B: Attract and convert more customers on your website right now 

Screen_Shot_2014-10-16_at_9.20.41_AM.png

Again, same email, same offer, different subject line. 

While variation A explicitly states what the recipient is receiving, variation B works to convey the value of the guide without making mention of it. 

Here's what we found:

 
png-8-1.png
 

 

Right off the bat we noticed that the test had little to no effect on whether or the recipients decided to open the email. 

At first we couldn't believe it.

Seriously? A .5% discrepancy? Is this real life?

Once the initial shock wore off, we revisited the data and redirected our attention to click-to-open rate.

While 10.9% of the people who opened variation A clicked-through to the offer, only 7.8% of the people who opened variation B clicked. 

Aha! It appeared that we were on to something, but what?

While the mismatched subject lines had little influence on a recipient's decision to open the email, it did, in fact, impact their decision to click-through. 

But why?

Here's what you should know:

According to MailChimp, “the best subject lines tell what's inside, and the worst subject lines sell what's inside.

We concur. 

Our test results revealed that people are more likely to engage with the content inside your email if you clearly set the expectation in the subject line. 

The recipients of variation A knew what they were getting into before they opened the email. The subject line was straight up. 

When they clicked into the email, The Beginner's Guide was there waiting for them, as expected. They clicked. 

The recipients of variation B received something a bit sexier. More actionable. More benefit-driven. Less explicit. 

When they clicked into the email, they were met with an offer that they may or may not have been expecting given the ambiguity of the subject line. They clicked less. 

This doesn't mean that you should flee to your email composer of choice and start blasting out definitive subject lines. Let's not get carried away. 

But it does serve as valuable data to call up when deciding between one subject line or another. 

Again, this is not the end all be all. 

Like any good A/B test, we'll repeat this experiment several times in an effort to replicate the results and ensure validity. 

We encourage you to do the same. The more data-backed email subject line best practices out there the better.

Happy testing! 

Want to learn more about digital sales and marketing?

Master digital sales and marketing when you join IMPACT+ for FREE. Gain instant access to exclusive courses and keynotes taught by Marcus Sheridan, Brian Halligan, Liz Moorehead, Ann Handley, David Cancel, Carina Duffy, Zach Basner, and more.

Sign up for free
Take a peek

Access hundreds of FREE courses and keynotes

Free Course
Digital Sales & Marketing Framework for Today’s Buyers
By: Marcus Sheridan
View Course Preview View Course Preview
Free Keynote
A New Way to Compete & Win
By: Brian Halligan
View Course Preview View Course Preview
Free Virtual Keynote
How To Genuinely Feel Confident, Be Likable, And Build Trust On Camera
By: Liz Moorehead
View Course Preview View Course Preview
Free Keynote
The Future of Marketing is Conversational​
By: David Cancel
View Course Preview View Course Preview
Free Deep Dive
HubSpot On a Budget: Getting Started with HubSpot Starter Hubs
By: Courtney Caldwell
View Course Preview View Course Preview
Free Course
Assignment Selling: Content is Your Greatest Sales Tool
By: Marcus Sheridan
View Course Preview View Course Preview
Free Keynote
The Big, Bold, Brave New World of Marketing​
By: Ann Handley
View Course Preview View Course Preview
Free Course
Investing in Incredible Digital Sales and Marketing Results
By: Chris Duprey
View Course Preview View Course Preview
Free Course
How To Show Your Content Makes Money With HubSpot Marketing and Sales Hubs
By: Liz Moorehead
View Course Preview View Course Preview
Free Virtual Keynote
The Visual Sale
By: Marcus Sheridan & Tyler Lessard
View Course Preview View Course Preview
Free Keynote
Marketing Tech: What’s Now, What’s Near and What’s Not Anytime Soon?​
By: Dharmesh Shah
View Course Preview View Course Preview
Free Course
Inbound Lead Generation & Conversion Optimization
By: Carina Duffy
View Course Preview View Course Preview
Free Virtual Keynote
Fundamentals of Videography: You Can Be a Great Videographer Too
By: Zach Basner
View Course Preview View Course Preview
Free Deep Dive
The Ultimate Customer Service Toolkit for Any Budget
By: Andriti Gulati
View Course Preview View Course Preview
Free Course
6 Topics Subject Matter Experts Need to Address
By: Kevin Phillips
View Course Preview View Course Preview
Free Keynote
Fanocracy: The Power of Making Business Personal​
By: David Meerman Scott
View Course Preview View Course Preview
Free Keynote
The Power of Pillar Content
By: Liz Moorehead
View Course Preview View Course Preview
Free Keynote
SEO for the Future
By: Franco Valentino
View Course Preview View Course Preview
Free Course
Fundamentals of Social Media Marketing
By: Stephanie Baiocchi
View Course Preview View Course Preview
Free Deep Dive
A Practical Guide To Video Graphics
By: Colton Trcic
View Course Preview View Course Preview
Free Session
How To Get Your Community To Know, Like, And Trust You With Video
By: Marki Lemons Rhyal
View Course Preview View Course Preview
Free Course
Video Sales and Marketing Strategy
By: Zach Basner
View Course Preview View Course Preview
Here Are Some Related Articles You May Find Interesting

Want to Contribute Content to impactplus.com? Click Here.

IMPACT+ Sign Up
A FREE online learning community with on-demand courses, hundreds of expert-led sessions, thousands of your peers ready to support you, and much more.
Check it out
Hundreds of courses and recorded keynotes, completely FREE
Check it out
Access hundreds of digital sales and marketing courses and recorded keynotes, completely FREE