Building A Culture Of Optimization: What’s In It For You?

By Kevin Plankey

September 30, 2022


Instead of going with a gut feeling that a new website banner or offer is going to hit it out of the ballpark, retailers are relying more and more on data-driven strategies to drive measurable results with their web and mobile experiences.

A/B testing and optimization has been widely adopted in the online retail space where companies are parlaying the wins of the digital marketing team into expanded ownership of optimization to include UX, product management, and the development team. But, all these teams have different goals and motivations for A/B testing and optimization, so how can they come together to create a new culture of optimization? The answer is by uniting behind one overriding company goal of increased customer engagement, conversions, and subsequently increased revenue.

The culture of optimization is the shift that takes place when an organization has seen numerous and measurable wins from its A/B testing program, and as a result, has expanded experimentation beyond marketing to become part of the corporate culture. As a result, teams from marketing, product management, web/mobile development, and other departments, use A/B testing to prove or disprove their hypotheses. Gut feelings and opinions take a back seat to data-driven decisions that are driving omnichannel optimization of the customer experience.

Let’s take a deeper look at some of the teams driving this new culture of optimization:

  1. Marketing – The marketing team is concerned with driving traffic to the site, creating highly engaging promotions, offers, and campaigns, and ensuring that visitors stay and purchase. This team uses A/B testing to optimize marketing content by creating a targeted and engaging customer experience to drive conversions.
  2. Product Management – The product management team is usually on a tight deadline to create new site features and functionality. They’re generally focused on A/B testing new feature releases in order to mitigate risk and the functionality of on-site search algorithms.
  3. User Experience – The UX team cares about A/B testing new site designs, process flow changes, such as checkout and registration, and the overall look and feel of the site.
  4. Development – The development team is tasked with programming the content, features, and functionality of the site, working closely to the specifications of product management. So they’re focused not only with the A/B tests that product management is running, but also other experiments such as those concerning website performance, such as site speed.

Progression of an Optimization Culture

In an organization that has embraced an ongoing commitment to A/B testing and optimization, these teams break through the silos of the past and come together to create an organizational A/B testing team in order to find new opportunities for conversion, run more A/B tests in less time, and create measurable wins for the organization. Instead of running dozens of A/B tests a year, they’re running hundreds – if not thousands. Instead of running basic A/B tests on content, such as buttons, fonts, headlines, and placement, the new team is running much more sophisticated A/B tests, including:

  • check-out flow
  • pricing & shipping offers
  • dynamic content
  • new features
  • whole site releases
  • search algorithms

The Barriers Stopping The Culture of Optimization From Taking Hold

Believe it or not, one of the biggest barriers to making this new organizational-wide culture of optimization a reality can be the A/B testing tool itself. For example, tag-based tools can limit the number of A/B tests that can be run because they can’t easily A/B test features and functionality. But that’s where many of an organization’s next conversion opportunities actually live! From site search, pricing and shipping, check-out flow, to new features and whole site releases, the opportunities for A/B testing are almost limitless. And, the more A/B tests run, the more site improvements are made, the more lift in conversions the organization will see. The other issue to consider with tag-based A/B testing tools is that they can introduce page-loading latency as well as flicker while images load, creating a poor user experience.


Creating a culture of optimization by extending A/B testing beyond marketing can be done, and some of the world’s largest and most successful retailers are proving it. Take, for example, one of SiteSpect’s clients, an online retailer that A/B tested four different free shipping threshold prices. The winning threshold resulted in a 23% lift in average order value. Another customer A/B tested a five-step check-out process versus a one-step process. The winner produced a 4.3% conversion lift and 2.9% lift in average order value. When you’re not bound by the types of A/B tests you can run, every part of your site and/or app can be optimized. There is room for constant improvement, and after your organization adopts this new culture of optimization, the more wins it will rack up.

Once marketing, product management, UX, and the development teams unite and work towards a common goal, each team scores more wins and the company benefits as a result. The best part is, once your company reaches this tipping point, you’ll never want to go back.

Looking for more resources? Check out our free ebook: “Choosing an Optimization Platform”.

Wish to speak with an optimization expert? Schedule a discovery call! CLICK HERE


Kevin Plankey

Kevin Plankey

Kevin Plankey is the Director of Demand Generation for SiteSpect and is responsible for marketing operations to include strategy and implementation of all demand generation efforts: social, email, website, organic/paid media, and event planning & promotion.

Suggested Posts

Subscribe to our blog: