Free Assessment: How does your sales & marketing measure up?

Get Started
Close

Free Assessment:

How does your sales & marketing measure up?
Take this free, 5-minute assessment and learn what you can start doing today to boost traffic, leads, and sales.
Get Started
Carly Stec

By Carly Stec

Oct 16, 2014

Topics:

Lead Generation
Lead Generation

Straight Up vs Sexy: Testing Email Subject Lines

Carly Stec

By Carly Stec

Oct 16, 2014

Straight Up vs Sexy: Testing Email Subject Lines

Testing Email Subject LinesIf you ask a marketer what goes into a great email subject line, it's likely that you'll get a dozen different answers.

If you Google it, you'll be met with several dozen more. 

Now what? 

With so much riding on the performance of an email's subject line, we took matters into our own hands and conducted an A/B test comparing two different subject lines promoting the same offer. 

The results are in and we're ready to walk you through it. Let's go.

Here's what the A/B test looked like:

Variation A: The Newly-Updated Beginner's Guide to Inbound Marketing

 

Screen_Shot_2014-10-15_at_10.24.29_AM.png

 

Variation B: Attract and convert more customers on your website right now 

Screen_Shot_2014-10-16_at_9.20.41_AM.png

Again, same email, same offer, different subject line. 

While variation A explicitly states what the recipient is receiving, variation B works to convey the value of the guide without making mention of it. 

Here's what we found:

 
png-8-1.png
 

 

Right off the bat we noticed that the test had little to no effect on whether or the recipients decided to open the email. 

At first we couldn't believe it.

Seriously? A .5% discrepancy? Is this real life?

Once the initial shock wore off, we revisited the data and redirected our attention to click-to-open rate.

While 10.9% of the people who opened variation A clicked-through to the offer, only 7.8% of the people who opened variation B clicked. 

Aha! It appeared that we were on to something, but what?

While the mismatched subject lines had little influence on a recipient's decision to open the email, it did, in fact, impact their decision to click-through. 

But why?

Here's what you should know:

According to MailChimp, “the best subject lines tell what's inside, and the worst subject lines sell what's inside.

We concur. 

Our test results revealed that people are more likely to engage with the content inside your email if you clearly set the expectation in the subject line. 

The recipients of variation A knew what they were getting into before they opened the email. The subject line was straight up. 

When they clicked into the email, The Beginner's Guide was there waiting for them, as expected. They clicked. 

The recipients of variation B received something a bit sexier. More actionable. More benefit-driven. Less explicit. 

When they clicked into the email, they were met with an offer that they may or may not have been expecting given the ambiguity of the subject line. They clicked less. 

This doesn't mean that you should flee to your email composer of choice and start blasting out definitive subject lines. Let's not get carried away. 

But it does serve as valuable data to call up when deciding between one subject line or another. 

Again, this is not the end all be all. 

Like any good A/B test, we'll repeat this experiment several times in an effort to replicate the results and ensure validity. 

We encourage you to do the same. The more data-backed email subject line best practices out there the better.

Happy testing! 

Free Assessment:

How does your sales & marketing measure up?
Take this free, 5-minute assessment and learn what you can start doing today to boost traffic, leads, and sales.

Related Articles

Demand Generation vs. Lead Generation: What’s the Difference?

April 10, 2023
Kristen Harold Kristen Harold

35 Landing Page Examples to Inspire Yours in 2023

January 26, 2023
Ramona Sukhraj Ramona Sukhraj

Should You Still Gate Your Content in 2023?

January 23, 2023
John Becker John Becker

Here's Why You Keep Getting Garbage Inbound Marketing Leads

December 19, 2022
Jessica Palmeri Jessica Palmeri

How To Grow Your Email List: 13 Savvy Tips To Try in 2023

November 22, 2022
Ramona Sukhraj Ramona Sukhraj

Increase Landing Page Conversion Rates With These 3 Simple, Powerful Hacks

June 2, 2022
Hannah Woods Hannah Woods

20 Tips for Optimizing Your Business Blog Articles for Conversions

April 21, 2022
Jen Barrell Jen Barrell

How To Make Each Lead Capture Form a Conversion Powerhouse

April 8, 2022
Carolyn Edgecomb Carolyn Edgecomb

The Selling 7: 5 Best Landing Page Video Examples

December 23, 2021
Zach Basner Zach Basner

Rethinking Your Approach to B2B Lead Gen, ft. Chris Walker (Inbound Success, Ep. 200)

June 21, 2021
Kathleen Booth Kathleen Booth

What is the Content Marketing Funnel and How Does It Work?

June 2, 2021
Kimberly Marshall Kimberly Marshall

What is Lead Nurturing?

May 28, 2021
Kimberly Marshall Kimberly Marshall

88 compelling words and phrases to prompt website visitors into action [Infographic]

April 24, 2021
Kaitlyn Petro Kaitlyn Petro

What is Conversion Rate Optimization? (Definition, Examples, and Tips)

March 31, 2021
Jolie Higazi Jolie Higazi

What is a good average landing page conversion rate?

March 12, 2021
Christine Austin Christine Austin

Call-To-Action Examples: 31 Designed to Earn Clicks and Generate Leads

March 11, 2021
Karisa Hamdi Karisa Hamdi

6 Reasons You're Not Generating Leads With Your Blog Content

November 9, 2020
Justine Timoteo Thomas Justine Timoteo Thomas

9 keys to building an effective landing page [Infographic]

October 3, 2020
Steve Polito Steve Polito

5 effective strategies for decreasing bounce rates on a blog article

August 25, 2020
Kevin Phillips Kevin Phillips

7 savvy tips to boost conversions in your retail e-commerce store

July 17, 2020
Pratik Dholakiya Pratik Dholakiya

6 most common lead generation website problems (and how to fix them)

January 28, 2020
Jen Barrell Jen Barrell

Facebook ads help: Why are my ads not converting?

January 20, 2020
Rachel Palmateer Rachel Palmateer

11 Best Examples of Lead Generation Website Designs

January 20, 2020
Justine Timoteo Thomas Justine Timoteo Thomas

Top 9 proven lead generation ideas you need to try in 2020

December 3, 2019
Ali Parmelee Ali Parmelee

New study reveals which Google My Business features boost conversions

November 4, 2019
Jenna Ott Jenna Ott