A/B & Multivariate Testing

Test ideation is a sore spot for many teams. You’d be surprised at how many go off of gut feelings and “we think,” “we feel,” and “we believe” statements. Usually, team members are not in the target audience. So why would their opinions be applicable? Even if they were, what basis do you have to…

Data analysis is the crux of A/B testing and optimization. But many of us who do A/B testing and optimization aren’t data analysts by trade; we’re learning as we go. One of the most common mistakes we see in A/B testing is not segmenting data. To understand how your A/B tests are performing and how…

Optimization teams, especially new ones, A/B test aspects of their digital properties that have been frequent subjects of debate, like button colors, calls to action, and hero images. These tests can be important to conversion rates and average order values. These A/B tests are simple to set up, easy to explain, and winners are usually…

When you first start managing an A/B testing and optimization program, the possibilities can be both exciting and overwhelming. Chances are you’ve had a running list of improvements you want to make to your site and are eager to finally implement and test those. However, despite the temptation to jump into everything all at once,…

In two minutes, how many businesses can you name that are out of business today, but were thriving when you were younger? I’ll give you time to think. Did brands like Toys R Us, Sports Authority, Blockbuster, Lord & Taylor, and Dressbarn come to mind? Were Pier 1 Imports, A&P Supermarkets, or Borders on your…

Several months ago, I posted about mistakes to avoid when A/B testing. Over the next few weeks, I want to get into a little more detail about other mistakes to avoid when A/B testing. This week, we’ll talk about setting the wrong metrics. Setting the Wrong Metrics It takes some experience to know all the…