Control your environment without installing any third-party code.As an add-on package, SiteSpect Enhanced Analytics combines two powerful tools to fortify and finely tune campaign data:
  1. Outlier Data: To identify and mitigate anomalous data that can skew data-driven decision making.
  2. Real User Monitoring (RUM): Capture & analyze actual user interactions and layer performance metrics into any campaign report.
For more information visit
SiteSpect is CCPA Compliant. The California Consumer Privacy Act (CCPA) is a state statute intended to enhance privacy rights and consumer protection for US residents of California. More information about SiteSpect’s CCPA support is located on our Customer Notice On EU GDPR and CCPA Support page.SiteSpect will dedicate resources to the equivalent of a full-time employee to work with your team at your offices.SiteSpect will dedicate resources to the equivalent of a half-time employee to work exclusively with your team across any of the professional services.SiteSpect will dedicate resources to the equivalent of a full-time employee to work exclusively with your team across any of the professional services.SiteSpect provides on-site training sessions custom designed especially for your business and IT teams to help you achieve your business goals.SiteSpect has a curriculum of training modules and best practices that you can take advantage of to increase your team's adoption and mastery of the user interface.We offer training to get you up and running quickly, including test building courses & analytics interpretation.Take advantage of SiteSpect's premium help and knowledge portal where you will find FAQs, how-tos, and detailed step-by-step instructions for successful use of the SiteSpect platform.We offer monthly webinars on SiteSpect featured functionalities and best practices for increased value and success.Identify additional testing and personalization opportunities from the results of past campaigns.Our professional services team will work with you to create visualizations to demonstrate how SiteSpect affects your revenue.Optimization Consultants will provide full analytical reports on campaign performance, highlighting KPI impact, segment analysis, and key insights.Optimization Consultants will show you the best way to get the most out of your traffic across a large number of tests and personalization campaigns.Learn how to track and monitor running tests and personalization campaigns.Learn best practices for efficiently creating and executing tests and personalization campaigns.Design, develop, and optimize all of the components for your program.Learn how to structure experiments to maximize learning and efficiency. A/B vs. MVT, Controlled Experiments vs. Personalization.Add a workflow tool to integrate your prioritization and team workflow directly into SiteSpect.Your Optimization Consultant provides best practices and process recommendations for running a high functioning optimization program.SiteSpect will provide guidance and support for making decisions regarding scheduling tests in order to maximize efficiency and generate as much learning as possible as efficiently as possible.Working with key stakeholders in your organization, SiteSpect will provide test ideas that improve the customer experience and move the needle on your key performance metrics.Your Optimization Consultant will provide best practices for creating data-driven hypotheses that answer key business questions.Based on our experience and your analytics, your Optimization Consultant will help you identify optimization opportunities and establish a workflow for collecting and managing input from across your organization.Provided by your SiteSpect Optimization Consultant who understands your business objectives and works with you to achieve your testing goals and increase ROI.Number of hours SiteSpect professional services representatives will work on strategy, creation, or analysis for your optimization program.Enforce an optimization workflow with campaign administrators, builders and read-only roles.Custom integration with 3rd party tools such as Adobe Analytics, Google Analytics, CrazyEgg, Hotjar and more.Build and optimize the customer experience on iOS and Android apps. Build experiences visually, directly on your mobile device, leverage our SPAs or use API only solution.Leverage Custom Variables to capture dimensions about users, such as products purchased, categories viewed and items searched.Isolate users in single Campaigns or allow them in multiple overlapping experiences.Create a unified customer experience by connecting experiences for recognized users across devices.Automate your optimization program through our API: and deploy server-side functionality with on/off switches or progressive rollouts. Leverage cookies, headers or parameters for feature flagging. Test and optimize your CMS, recommendation engine, and other vendor tools.Leverage our SPA SDK to test and optimize your Single Page Application. Support for major frameworks such as Angular, React, and others.Modify the source code of pages on the fly with Regular Expressions, with zero impact to performance. Replace, remove, add in new functionality before pages are rendered in the browser.SiteSpect offers a number of capabilities for effective front-end testing. Use Visual Editor or Regular Expressions to modify source code, support SPA frameworks, define pages for reusability in tests, and minimize performance hits for users and servers.Use point-and-click actions to modify text, images, buttons, promotional banners, and styling. Create, move, rearrange, hide, and track behaviors across channels. Works with SPAs out of the box, such as React and Angular.Push winning Variations to all traffic to benefit early from wins. Push hot fixes your website to quickly resolve issues, to all traffic or segments of users.Respond to real-time alerts and in-product messages to proactively manage your campaigns. Known when a campaign has a winning variation, is hurting conversion, does not have any recent visits, or is disabled.Quickly analyze and understand relevant campaigns and outcomes. Measure conversion, KPIs, user actions, events, conversion funnels, and other key user interactions in our comprehensive dashboard.Personalize the experience for mobile devices, geo location, user types, and user behaviors. Build your own Audiences to align with your key segments of users and leverage your Data Layer.Experience our proxy architecture built from the ground up to avoid flicker and ensure fast experience delivery across desktop, tablet, and mobile devices.Training to get you up and running quickly, includes test building courses & analytics interpretation.Dedicated optimization consultant for strategic and tactical guidance. Your GoLive Report is a success plan to get your team up and running, including website audit, test ideas and optimization roadmap. You will also get ROI (return on investment) modeling backed by Forrester.Depending on which package there are countless tests, segmentations and optimizations within your control across almost any digital touchpoint.Run as many Campaigns as you want.Our optimization experts work with you to recommend 10 impactful test ideas to improve customer experience and impact your bottom line, and build 10 Campaigns so you can quickly benefit from our platform.Directly ingest SiteSpect traffic logs into your monitoring infrastructure to diagnose underperforming applications/servers and identify site errors in near real time.SiteSpect sends a sample of log data to, a log visualization service. This service offers full flexibility to view and analyze logs relating to traffic health and routing. Your network operations center can also use this service to build your own visualization and dashboards or integrate into existing systems.SiteSpect is GDPR Compliant. The General Data Protection Regulation (GDPR) is a legal framework that sets guidelines for the collecting and processing personal information of individuals within or who are citizens of the European Union. More information about SiteSpect’s GDPR support is located on our Customer Notice On EU GDPR Support page.SiteSpect is HIPAA ready, which saves you time when you use SiteSpect in your HIPAA-compliant environment. SiteSpect obfuscates and encrypts visitor behavior and does not store any personal data. SiteSpect also offers on-premise and other deployment models to guarantee personal data never leaves your datacenter.SiteSpect supports Single Sign-On (SSO) authentication through Active Directory and SAML. SSO allows you to centrally manage SiteSpect permissions and login credentials. It also makes it easier for SiteSpect users to quickly log in and switch between their applications saving time and improving productivity.Restrict user access to SiteSpect by IP address.Restrict access to your websites by IP address. Create lists or ranges of IP addresses that allow trusted (whitelisted) users to access your websites or prevent access from disallowed (blacklisted) users.Two-Factor Authentication, also known as 2FA, requires not only a password and username but also something that only a user has access to, such as a token. Using a username and password together with a token makes it harder for potential intruders to gain access to SiteSpect.SiteSpect complies with both the EU-US and the Swiss-US Privacy Shield Frameworks. SiteSpect certifies that it adheres to the Privacy Shield Principles with respect to personal data. More information about SiteSpect’s Privacy Shield support is available on our Business Services Privacy Policy - GDPR and Privacy Shield page.SiteSpect includes a complete history of every user action. Quickly undo changes in the audit history list and audit any change as part of your change management process.SiteSpect maintains the privacy of all customer data by ensuring no test data is exposed and that data is not grouped with or shared with others in any way.SiteSpect leverages Alert Logic to monitor and track security vulnerabilities. This provides you with an additional line of defense as we will notify you of any detected threats or attacks on your website.SiteSpect supports nine different permission levels that provide control and configurable access. Set view and edit permissions on a per user basis for building, managing, and analyzing campaigns.SiteSpect fully supports encryption for all types of in-transit data such as end-user content, SDK and API transmissions, and business user data. We also support testing on HTTP and HTTPS websites.

Measuring a Website A/B Testing and Optimization Program (Part 3)

January 29, 2013


In this post, we’ll look how to measure and communicate the results of your website optimization program.

A/B testing platforms and analytics applications are naturally related: One is fundamentally designed to drive improvements on your site, and the other is fundamentally designed to help quantify the value of those improvements. Although some A/B testing applications do a good job of helping quantify success on their own, the integration of A/B testing with analytics allows companies to develop a very broad view of the results of individual A/B tests.

On the subject of measurement, one point is very important and frequently overlooked: The combination of measurement and A/B testing should support both optimization and an incremental learning process about your visitors and customers.

Assuming you have a robust measurement program already in place, the integration of A/B testing into those efforts is often a trivial effort and requires little more than patience. The upside from taking the time to integrate these systems correctly includes the ability to evaluate A/B testing efforts over multiple criteria and the ability to evaluate A/B test participant behavior over multiple sessions.

Seemingly dramatic design changes often have no significant impact when examined using simple measures such as click-through and conversion rate. An increasing number of companies have started applying more complex measures, such as “return visitation rate” and “lifetime customer value,” and using more qualitative measurement systems to develop a more holistic view of A/B test impact.

Although the specific measures you take will likely vary from A/B test to A/B test, depending on the systems you have in place, an important consideration is the ability to integrate those systems. The basic integration of A/B testing and measurement systems involves exchanging data about A/B test participation, either by after-the-fact bulk data loading or by real-time tag transformation. Done well, such integration allows the measurement team to create segments, build key performance indicators, and drill down into the activity of individual visitors based on A/B test participation (via the use of data warehousing and customer experience management technologies).

The integration of measurement and A/B testing is designed to help you better quantify A/B test performance and the resulting impact on the business. Integrated systems, when properly used, support a wide range of metrics and measures and support the analysis of both short- and long-term impact of A/B tests. The long-term view towards A/B testing is one that few companies currently take today, but that view most often reveals a great deal of insights about visitor behavior.

Communicating Your A/B Test Results With Actionable Analysis

Once you’ve formed a great A/B testing team, gotten your senior stakeholders on board, and received solid testing plans back from the organization, you owe it to the organization to communicate back what you learned after you ran your A/B tests.

To take full advantage of your investment in A/B testing, consider taking a two-pronged approach to communicate the results by specifically addressing the needs of your two audiences—the group requesting the A/B test, and the wider organization:

  1. For the group that requested the A/B test, go deep. Plan to provide detailed information about the A/B test and what was learned, including a reiteration of the A/B test plan, an A/B test timeline, a summary of resources used in the project (ideally tied to costs associated with their time), plus as much detail about the results of the A/B test as possible, including the underlying statistical data. In our experience, mapping external events onto the A/B test results, whenever possible, is an excellent idea. For example, if you know a substantial email campaign occurred, or if the New York Times wrote about your company, add a point on your results timeline that specifically addresses those events.
  2. For the wider organization, go broad. The rest of the company is likely not as interested in the details of the A/B test as they are the “big picture,” including the bottom-line summary of results and a comparison of how similar A/B tests have performed in the past.One thing that gets people’s attention better than anything else is associating A/B test results with money—either incremental revenue or operational savings. Funny how the addition of “and we expect this change to result in an estimated $20,000,000 in incremental revenue every year” gets people’s undivided attention.

For both groups, make sure you take a bottom-line, up-front approach toward the communication of results. By doing so, you dramatically increase the likelihood of getting people’s attention to important news, and allow them to make their own decision about the level of attention they give to the results.

Whenever possible, present A/B test results in person and in a format that encourages interaction. Especially when companies are new to the A/B testing process, such social interaction helps to improve organizational awareness about A/B testing while challenging the A/B testing team members to continually improve their ability to present, discuss, and defend A/B test results. The value of the latter cannot be underestimated, because so very few employees in the workplace today have experience with A/B testing and optimization.

Consider documenting A/B test results electronically using an internal blog or wiki. The wiki format especially lends itself to creating a complete body of knowledge—what was the A/B test plan, what were the measures of success, what happened, and what was learned—in a searchable format. When you start to aggressively A/B test, people’s collective ability to recall every A/B test and all that has been previously learned becomes limited. Having a resource that can be easily searched at the onset of a new project will allow the A/B testing team to build on its knowledge and not repeat past mistakes.

The most important thing when presenting A/B test results is to provide the audience with actionable recommendations. Nothing is less satisfying than a great presentation chock full of data with no recommendations for action—especially in the current and decidedly harsh economic climate. The best A/B testing teams will go the extra mile and make multiple recommendations in an attempt to capitalize on the results and build consensus for the adoption of the successful challenger design.

Use the presentation of recommendations to suggest other opportunities for A/B testing. The ultimate goal is to build a culture of A/B testing within your organization, one that is willing to increasingly incorporate data from measurement and A/B testing efforts into the overall business decision-making process.

A/B testing can be a powerful ally to business—but only when the organization takes the time to understand what can be learned and then act on that information. The worst-case scenario in A/B testing and optimization is one where measurement is guiding A/B testing and A/B testing is informing good recommendations that are ignored and not acted on.

(For more information, download the whitepaper titled “Successful Web Site Testing Practices: Ten Best Practices for Building a World-Class Testing and Optimization Program.”)

To learn more about SiteSpect, visit our website.



Suggested Posts


Release Testing for Risk Mitigation

hands typing quickly.jpg

How to Simplify and Accelerate Web Changes

Christmas sales. Woman shopping with smartphone by laptop in home interior. Xmas concept. Planning holidays.

Product Recommendations for the Holiday Season

Leave a Comment

Your email address will not be published. Required fields are marked *