Free Assessment: How does your inbound marketing measure up?

Get Started
Close

Free Assessment:

How does your inbound marketing measure up?
Take this free, 5-minute assessment and learn what you can start doing today to boost traffic, leads, and sales.
Get Started
inbound-marketing-strategy-playbook-cover

Free Assessment:

Straight Up vs Sexy: Testing Email Subject Lines

By Carly Stec

Straight Up vs Sexy: Testing Email Subject Lines

Testing Email Subject LinesIf you ask a marketer what goes into a great email subject line, it's likely that you'll get a dozen different answers.

If you Google it, you'll be met with several dozen more. 

Now what? 

With so much riding on the performance of an email's subject line, we took matters into our own hands and conducted an A/B test comparing two different subject lines promoting the same offer. 

The results are in and we're ready to walk you through it. Let's go.

Here's what the A/B test looked like:

Variation A: The Newly-Updated Beginner's Guide to Inbound Marketing

 

Screen_Shot_2014-10-15_at_10.24.29_AM.png

 

Variation B: Attract and convert more customers on your website right now 

Screen_Shot_2014-10-16_at_9.20.41_AM.png

Again, same email, same offer, different subject line. 

While variation A explicitly states what the recipient is receiving, variation B works to convey the value of the guide without making mention of it. 

Here's what we found:

 
png-8-1.png
 

 

Right off the bat we noticed that the test had little to no effect on whether or the recipients decided to open the email. 

At first we couldn't believe it.

Seriously? A .5% discrepancy? Is this real life?

Once the initial shock wore off, we revisited the data and redirected our attention to click-to-open rate.

While 10.9% of the people who opened variation A clicked-through to the offer, only 7.8% of the people who opened variation B clicked. 

Aha! It appeared that we were on to something, but what?

While the mismatched subject lines had little influence on a recipient's decision to open the email, it did, in fact, impact their decision to click-through. 

But why?

Here's what you should know:

According to MailChimp, “the best subject lines tell what's inside, and the worst subject lines sell what's inside.

We concur. 

Our test results revealed that people are more likely to engage with the content inside your email if you clearly set the expectation in the subject line. 

The recipients of variation A knew what they were getting into before they opened the email. The subject line was straight up. 

When they clicked into the email, The Beginner's Guide was there waiting for them, as expected. They clicked. 

The recipients of variation B received something a bit sexier. More actionable. More benefit-driven. Less explicit. 

When they clicked into the email, they were met with an offer that they may or may not have been expecting given the ambiguity of the subject line. They clicked less. 

This doesn't mean that you should flee to your email composer of choice and start blasting out definitive subject lines. Let's not get carried away. 

But it does serve as valuable data to call up when deciding between one subject line or another. 

Again, this is not the end all be all. 

Like any good A/B test, we'll repeat this experiment several times in an effort to replicate the results and ensure validity. 

We encourage you to do the same. The more data-backed email subject line best practices out there the better.

Happy testing! 

Free Assessment:

How does your inbound marketing measure up?
Take this free, 5-minute assessment and learn what you can start doing today to boost traffic, leads, and sales.

Topics:

Lead Generation
Published on October 16, 2014

Recent Articles

35 Landing Page Examples to Inspire Yours in 2023
January 26, 2023 • 11 min read
Should You Still Gate Your Content in 2023?
January 23, 2023 • 5 min read
Here's Why You Keep Getting Garbage Inbound Marketing Leads
December 19, 2022 • 6 min read
How To Grow Your Email List: 13 Savvy Tips To Try in 2023
November 22, 2022 • 9 min read
Demand Generation vs. Lead Generation: What’s the Difference?
June 6, 2022 • 5 min read
Increase Landing Page Conversion Rates With These 3 Simple, Powerful Hacks
June 2, 2022 • 10 min read
20 Tips for Optimizing Your Business Blog Articles for Conversions
April 21, 2022 • 14 min read
How To Make Each Lead Capture Form a Conversion Powerhouse
April 8, 2022 • 7 min read
The Selling 7: 5 Best Landing Page Video Examples
December 23, 2021 • 7 min read
Rethinking Your Approach to B2B Lead Gen, ft. Chris Walker (Inbound Success, Ep. 200)
June 21, 2021 • 36 min read
What is the Content Marketing Funnel and How Does It Work?
June 2, 2021 • 10 min read
What is Lead Nurturing?
May 28, 2021 • 9 min read
88 compelling words and phrases to prompt website visitors into action [Infographic]
April 24, 2021 • 3 min read
What is Conversion Rate Optimization? (Definition, Examples, and Tips)
March 31, 2021 • 12 min read
What is a good average landing page conversion rate?
March 12, 2021 • 10 min read
Call-To-Action Examples: 31 Designed to Earn Clicks and Generate Leads
March 11, 2021 • 10 min read
6 Reasons You're Not Generating Leads With Your Blog Content
November 9, 2020 • 7 min read
9 keys to building an effective landing page [Infographic]
October 3, 2020 • 3 min read
5 effective strategies for decreasing bounce rates on a blog article
August 25, 2020 • 8 min read
7 savvy tips to boost conversions in your retail e-commerce store
July 17, 2020 • 6 min read
6 most common lead generation website problems (and how to fix them)
January 28, 2020 • 8 min read
Facebook ads help: Why are my ads not converting?
January 20, 2020 • 5 min read
11 Best Examples of Lead Generation Website Designs
January 20, 2020 • 9 min read
Top 9 proven lead generation ideas you need to try in 2020
December 3, 2019 • 3 min read
New study reveals which Google My Business features boost conversions
November 4, 2019 • 4 min read