Often, when you’re working on a website you’ll rely on your intuition and experience to decide what designs work best. However, using data to make informed decisions is an even better approach. The question is: How can you figure out which design users will prefer?

The answer lies in A/B testing, which is the process of presenting two versions of a web page to visitors and collecting data about which one they prefer. With this information, you’ll be able to create pages that users love, all based on concrete data.

In this article, we’re going to give you a crash course on A/B testing, and explain why you should consider conducting it on your website. Then we’ll teach you how to A/B test your site, and introduce you to some WordPress plugins that can help. Let’s move over to the lab!

WHAT IS A/B TESTING?

A/B (or ‘split’) testing is a process where you take two versions of an element and display each to a random sample of your visitors. The goal is that, with a large enough sample size, you can gain insight into which version your users prefer.

Imagine, for example, that you’re adding a new Call To Action (CTA) to your landing page. You’re not sure what design will work best, but you’ve narrowed the choices down to two options. If you set up an A/B test, you can track which CTA your visitors respond better to, by measuring how many clicks each version gets.

That’s just a basic example, and in practice you can use A/B testing to measure all kinds of variables. In fact, A/B testing is something you can benefit from in a broad range of situations, whether it’s for a website, a product design, an email campaign, or something else entirely.

WHY SHOULD YOU A/B TEST?

If you’re an experienced enough developer or designer, you might be able to rely on your intuition to determine what designs work best. However, if you really want to know what your users want, running some tests is a smart idea.

Let’s break down exactly how A/B testing can benefit you:

• It can provide you with highly-targeted data about what your visitors prefer.
• You can run successive A/B tests to fine-tune almost every aspect of your website.
• Implementing the results of this testing can help you improve conversions across the board.

What’s more, you can use A/B testing for all kinds of variables. In our experience, you can get fantastic results testing variations of copy, color schemes, ads, website layouts, and more. There are some limitations on the type of elements you can A/B test, however, which we’ll talk more about in a moment.

HOW TO RUN A/B TESTS

When you run an A/B test, it helps to think of your website as a lab. If you want to get accurate results, you’ll need to follow strict procedures to make sure the data you gather is accurate. Here’s the approach we suggest you follow.

STEP 1: IDENTIFY POTENTIAL TEST SUBJECTS

Technically, you can run an A/B test for almost any variable you want. However, an ideal test subject should meet several criteria:

• The page or element needs to receive a decent amount of traffic.
• There has to be room for improvement, so you can gauge test results.
• You need to be able to create variations of the test subject.

In particular, without enough traffic, the results you get won’t be statistically significant. A few dozen visits doesn’t make for a reliable sample size.

STEP 2: DECIDE ON YOUR GOALS

Once you have a subject in mind, you need to set a goal for your test. There are several metrics you might use as your goal, including:

1. Clicks
2. Page impressions
3. Mouseovers
4. Bounce rate

For example, let’s say that you intend to run an A/B test for a CTA. In that case, the appropriate metric to track would be clicks. To put it another way, the goal of your test will depend on what its subject is.

STEP 3: CHOOSE A HYPOTHESIS

At this point, you have a variable and a metric to test. Now you need to formulate a hypothesis, in order to run your experiment.

To elaborate on our earlier CTA example, here a few potential hypotheses you might test:

1. Changing the text of my CTA will improve conversions.
2. Using a different color for my CTA will result in more clicks.
3. Changing the location of my CTA will increase its Click-Through Rate (CTR).

All three of these are perfectly fine hypotheses. However, it’s important to remember that you can only test one of them at a time.

STEP 4: RUN YOUR TEST AND ANALYZE THE RESULTS

Now, you can finally put your test into action. To do this, you’ll need to use an A/B testing tool that enables you to show visitors both versions of your test subject (we’ll introduce a few options in a moment).

In our experience, a successful A/B test requires a sample size of at least a few thousand visitors. The smaller your sample pool is, the less reliable your results will be, so you don’t want to rush the process.

Once you have enough data, you can end the test and determine which version performed better according to the goal you set. Then, it’s just a matter of implementing that version on your live website and reaping the rewards!

WORDPRESS A/B TESTING PLUGINS

There are a lot of third-party plugins you can use for A/B testing your website. What follows are two of the best options available.

PLUGIN 1: NELIO AB TESTING

The first thing you need to know is that Nelio AB Testing requires you to sign up for a plan in order to use it. If you decide to pay for the plugin, you’ll get access to an A/B testing tool that enables you to run experiments on your pages, posts, and custom post types.

With Nelio AB Testing, you can compare headlines, widgets, CSS, and even entire themes. Plus, you’ll get access to highly-accurate heatmap functionality.

PLUGIN 2: POPUP BY SUPSYSTIC

Whereas our previous pick enables you to test almost any element you want, Popup by Supsystic focuses solely on pop-ups. With this plugin, you’ll be able to create and A/B test pop-ups that drive conversions. You’ll be happy to know that this plugin is free, and it supports an unlimited number of pop-ups.

A/B TESTING & THE WORDPRESS DIGITAL EXPERIENCE

A/B testing enables you to ‘poll’ your audience without them even knowing. That way, you’ll get access to quantifiable data you can use to improve your pages and provide your users with a better digital experience.

To run a successful A/B test, you’ll need a web host that provides you with rock-steady performance and support in case you run into any issues. That’s something we can promise on all our plans, so check them out today!