Learn
Learn
Close

They Ask, You Answer

A revolutionary approach to inbound sales, content marketing, and today’s digital consumer.

Learn MoreLearn More

Free Courses in IMPACT+

Dozens of sales, marketing, and content courses inside IMPACT+. Start learning now.

See all coursesSee all courses
Events
Events
Close
IMPACT+ Membership
IMPACT+ Membership
Close
Coaching & Implementation Services
Coaching & Implementation Services
Close

Services Overview

See how you can dramatically increase your inbound leads and sales.

Services Overview

Digital Sales and Marketing Mastery

Fast track your team’s success with IMPACT's most popular service.

Digital Sales and Marketing Mastery

Web Design

Launch a beautiful website that consistently generates leads and revenue.

Web Design

Virtual Sales Training

Equip your sales team with comprehensive training designed to help them close more deals in today's virtual-first world.

Virtual Sales Training

HubSpot Training & Implementation

Train your company to take ownership of HubSpot and get the most out of your investment.

HubSpot Training & Implementation

Case Studies

See dozens of examples of companies succeeding with Digital Sales and Marketing Mastery and They Ask, You Answer.

Case Studies
Become a Coach
Become a Coach
Close
A/B Testing Blunders: 5 Things You May Be Doing Wrong Blog Feature

Ramona Sukhraj

Associate Director of Content, Strategized Initiatives That Increased IMPACT’s Website Traffic From ~45K to ~400K

April 23rd, 2013 min read

Remember when science was cool; when Bill Nye, The Science Guy was your idol?

For many people, somewhere around high school, experiments stopped being fun and turned into a complicated burden. For Inbound Marketers, this meant poor ol' A/B testing got a bad rep.

A/B Testing, or "Split Testing" is as simple as black and white.

It's little insights can make a huge impact on your campaign, but unfortunately,  many Inbound Marketers are still falling victim to the age old scientific stigma and steer clear!

5 Things you may be doing wrong with your A/B Testing

1. Jumping to Conclusions

Whether you are an impatient 11th grader in Chem lab or an anxious Inbound Marketer under a deadline, one mistake (or "scientific error") everyone makes is jumping to conclusions. It is important to let your experiment run its course.

If you make a decision too early, based on results from only a day or two, it's not likely that you reached a large enough representative sample. Most A/B testing tools report with statistical confidence (statistical significance/credibility) in mind, but you may want to consider using an online calculator to determine how long your test should run.

2. Surprising Your Regulars

Heed my warning: never "experiment" with your regular visitors. Testing your regulars may run the risk of scaring them away with a random variation you will not even end up using.

Instead only include new visitors. Their reactions will be unbiased and won't risk you losing visitors you have already won over.

3. Not Testing Simultaneously

Always test your variations at the same time. The goal of an A/B test is to determine which alternative performs better than the other, but  when you don't test simultaneously, you introduce different variables (i.e. varying site traffic) that may skew your data.

4. Choosing "Instincts" Over Test Results

Just because the results don't meet your expectations doesn't mean they're wrong! Even the most experienced of Inbound Marketers can have their off days so if a result surprises you, goes against your intuition, or just isn't easy on the eyes, don't immediately reject it. Your goal is to achieve a hire conversion rate; no one said it was going to be pretty!

5. Being Inconsistent

Always make sure that your tests are consistent across your website. If you are testing a Call To Action that will appear in a sidebar across all of your pages, make sure that your visitor sees the same variation everywhere. This way you won't confuse your data by accidentally showing one person conflicting offers, colors, etc.

At the end of the day, A/B Testing need not be feared like the graded experiments of yesteryear. According to HubSpot, A/B testing has proven to generate up to 30-40% more leads for B2B sites and 20-25% more leads for eCommerce sites so take advantage of it! Put aside all of the misconceptions and try testing your:

    • Calls To Action (the wording, size, color and placement, etc),
    • Form Length & Fields,
    • Website layouts and styles,
    • Product pricing and promotional offers,
    • Headlines,
    • Images, and
    • Content Length.

After running several successful A/B tests,  the best results will rise to the surface to help convert your leads and optimize your sales.

Want to learn more about digital sales and marketing?

Master digital sales and marketing when you join IMPACT+ for FREE. Gain instant access to exclusive courses and keynotes taught by Marcus Sheridan, Brian Halligan, Liz Moorehead, Ann Handley, David Cancel, Carina Duffy, Zach Basner, and more.

Sign up for free
Take a peek

Access hundreds of FREE courses and keynotes

Free Course
Digital Sales & Marketing Framework for Today’s Buyers
By: Marcus Sheridan
View Course Preview View Course Preview
Free Keynote
A New Way to Compete & Win
By: Brian Halligan
View Course Preview View Course Preview
Free Virtual Keynote
How To Genuinely Feel Confident, Be Likable, And Build Trust On Camera
By: Liz Moorehead
View Course Preview View Course Preview
Free Keynote
The Future of Marketing is Conversational​
By: David Cancel
View Course Preview View Course Preview
Free Deep Dive
HubSpot On a Budget: Getting Started with HubSpot Starter Hubs
By: Courtney Caldwell
View Course Preview View Course Preview
Free Course
Assignment Selling: Content is Your Greatest Sales Tool
By: Marcus Sheridan
View Course Preview View Course Preview
Free Keynote
The Big, Bold, Brave New World of Marketing​
By: Ann Handley
View Course Preview View Course Preview
Free Course
Investing in Incredible Digital Sales and Marketing Results
By: Chris Duprey
View Course Preview View Course Preview
Free Course
How To Show Your Content Makes Money With HubSpot Marketing and Sales Hubs
By: Liz Moorehead
View Course Preview View Course Preview
Free Virtual Keynote
The Visual Sale
By: Marcus Sheridan & Tyler Lessard
View Course Preview View Course Preview
Free Keynote
Marketing Tech: What’s Now, What’s Near and What’s Not Anytime Soon?​
By: Dharmesh Shah
View Course Preview View Course Preview
Free Course
Inbound Lead Generation & Conversion Optimization
By: Carina Duffy
View Course Preview View Course Preview
Free Virtual Keynote
Fundamentals of Videography: You Can Be a Great Videographer Too
By: Zach Basner
View Course Preview View Course Preview
Free Deep Dive
The Ultimate Customer Service Toolkit for Any Budget
By: Andriti Gulati
View Course Preview View Course Preview
Free Course
6 Topics Subject Matter Experts Need to Address
By: Kevin Phillips
View Course Preview View Course Preview
Free Keynote
Fanocracy: The Power of Making Business Personal​
By: David Meerman Scott
View Course Preview View Course Preview
Free Keynote
The Power of Pillar Content
By: Liz Moorehead
View Course Preview View Course Preview
Free Keynote
SEO for the Future
By: Franco Valentino
View Course Preview View Course Preview
Free Course
Fundamentals of Social Media Marketing
By: Stephanie Baiocchi
View Course Preview View Course Preview
Free Deep Dive
A Practical Guide To Video Graphics
By: Colton Trcic
View Course Preview View Course Preview
Free Session
How To Get Your Community To Know, Like, And Trust You With Video
By: Marki Lemons Rhyal
View Course Preview View Course Preview
Free Course
Video Sales and Marketing Strategy
By: Zach Basner
View Course Preview View Course Preview
Here Are Some Related Articles You May Find Interesting

Want to Contribute Content to impactplus.com? Click Here.

IMPACT+ Sign Up
A FREE online learning community with on-demand courses, hundreds of expert-led sessions, thousands of your peers ready to support you, and much more.
Check it out
Hundreds of courses and recorded keynotes, completely FREE
Check it out
Access hundreds of digital sales and marketing courses and recorded keynotes, completely FREE