IMPACT Inbound Marketing Agency

They Ask, You Answer Mastery

A coaching & training program that drives unmatched sales & marketing results.


Sales Performance Mastery

Improve the competencies and close rates of your sales organization.

Web design

Website Mastery

Web design, development & training for your team.


HubSpot Mastery

Everything you need to get the most from HubSpot.

AI Mastery

AI Enablement Mastery

Unlock the power of AI in all aspects of your revenue operations.

Discover how IMPACT’s services can help take your business to the next level. Book a free 30-minute coaching session Book a free 30-minute coaching session
Learning Center
Learning Center

Learning Center

Free resources to help you improve the way you market, sell and grow your business.

[NEW] The Endless Customers Podcast is now available everywhere. Learn how to earn trust & win more customers in the age of AI. Listen Now Listen Now
Close Bottom Left Popup Offer
IMPACT Live Group

Register for IMPACT Live in Hartford CT, October 14-16!

Register for the one and only They Ask, You Answer conference before rates go up July 31! Save $200 now.
Lead Generation

A/B Testing Blunders: 5 Things You May Be Doing Wrong

Ramona Sukhraj

By Ramona Sukhraj

Apr 23, 2013

A/B Testing Blunders: 5 Things You May Be Doing Wrong

Remember when science was cool; when Bill Nye, The Science Guy was your idol?

For many people, somewhere around high school, experiments stopped being fun and turned into a complicated burden. For Inbound Marketers, this meant poor ol' A/B testing got a bad rep.

A/B Testing, or "Split Testing" is as simple as black and white.

It's little insights can make a huge impact on your campaign, but unfortunately,  many Inbound Marketers are still falling victim to the age old scientific stigma and steer clear!

5 Things you may be doing wrong with your A/B Testing

1. Jumping to Conclusions

Whether you are an impatient 11th grader in Chem lab or an anxious Inbound Marketer under a deadline, one mistake (or "scientific error") everyone makes is jumping to conclusions. It is important to let your experiment run its course.

If you make a decision too early, based on results from only a day or two, it's not likely that you reached a large enough representative sample. Most A/B testing tools report with statistical confidence (statistical significance/credibility) in mind, but you may want to consider using an online calculator to determine how long your test should run.

2. Surprising Your Regulars

Heed my warning: never "experiment" with your regular visitors. Testing your regulars may run the risk of scaring them away with a random variation you will not even end up using.

Instead only include new visitors. Their reactions will be unbiased and won't risk you losing visitors you have already won over.

3. Not Testing Simultaneously

Always test your variations at the same time. The goal of an A/B test is to determine which alternative performs better than the other, but  when you don't test simultaneously, you introduce different variables (i.e. varying site traffic) that may skew your data.

4. Choosing "Instincts" Over Test Results

Just because the results don't meet your expectations doesn't mean they're wrong! Even the most experienced of Inbound Marketers can have their off days so if a result surprises you, goes against your intuition, or just isn't easy on the eyes, don't immediately reject it. Your goal is to achieve a hire conversion rate; no one said it was going to be pretty!

5. Being Inconsistent

Always make sure that your tests are consistent across your website. If you are testing a Call To Action that will appear in a sidebar across all of your pages, make sure that your visitor sees the same variation everywhere. This way you won't confuse your data by accidentally showing one person conflicting offers, colors, etc.

At the end of the day, A/B Testing need not be feared like the graded experiments of yesteryear. According to HubSpot, A/B testing has proven to generate up to 30-40% more leads for B2B sites and 20-25% more leads for eCommerce sites so take advantage of it! Put aside all of the misconceptions and try testing your:

    • Calls To Action (the wording, size, color and placement, etc),
    • Form Length & Fields,
    • Website layouts and styles,
    • Product pricing and promotional offers,
    • Headlines,
    • Images, and
    • Content Length.

After running several successful A/B tests,  the best results will rise to the surface to help convert your leads and optimize your sales.

IMPACT Live Group

Register for IMPACT Live in Hartford CT, October 14-16!

Register for the one and only They Ask, You Answer conference before rates go up July 31! Save $200 now.
/* Infinite Scroll - Disabled on Articles to allow people to scroll to bottom page CTA */