Control your environment without installing any third-party code.As an add-on package, SiteSpect Enhanced Analytics combines two powerful tools to fortify and finely tune campaign data:
  1. Outlier Data: To identify and mitigate anomalous data that can skew data-driven decision making.
  2. Real User Monitoring (RUM): Capture & analyze actual user interactions and layer performance metrics into any campaign report.
For more information visit
SiteSpect is CCPA Compliant. The California Consumer Privacy Act (CCPA) is a state statute intended to enhance privacy rights and consumer protection for US residents of California. More information about SiteSpect’s CCPA support is located on our Customer Notice On EU GDPR and CCPA Support page.SiteSpect will dedicate resources to the equivalent of a full-time employee to work with your team at your offices.SiteSpect will dedicate resources to the equivalent of a half-time employee to work exclusively with your team across any of the professional services.SiteSpect will dedicate resources to the equivalent of a full-time employee to work exclusively with your team across any of the professional services.SiteSpect provides on-site training sessions custom designed especially for your business and IT teams to help you achieve your business goals.SiteSpect has a curriculum of training modules and best practices that you can take advantage of to increase your team's adoption and mastery of the user interface.We offer training to get you up and running quickly, including test building courses & analytics interpretation.Take advantage of SiteSpect's premium help and knowledge portal where you will find FAQs, how-tos, and detailed step-by-step instructions for successful use of the SiteSpect platform.We offer monthly webinars on SiteSpect featured functionalities and best practices for increased value and success.Identify additional testing and personalization opportunities from the results of past campaigns.Our professional services team will work with you to create visualizations to demonstrate how SiteSpect affects your revenue.Optimization Consultants will provide full analytical reports on campaign performance, highlighting KPI impact, segment analysis, and key insights.Optimization Consultants will show you the best way to get the most out of your traffic across a large number of tests and personalization campaigns.Learn how to track and monitor running tests and personalization campaigns.Learn best practices for efficiently creating and executing tests and personalization campaigns.Design, develop, and optimize all of the components for your program.Learn how to structure experiments to maximize learning and efficiency. A/B vs. MVT, Controlled Experiments vs. Personalization.Add a workflow tool to integrate your prioritization and team workflow directly into SiteSpect.Your Optimization Consultant provides best practices and process recommendations for running a high functioning optimization program.SiteSpect will provide guidance and support for making decisions regarding scheduling tests in order to maximize efficiency and generate as much learning as possible as efficiently as possible.Working with key stakeholders in your organization, SiteSpect will provide test ideas that improve the customer experience and move the needle on your key performance metrics.Your Optimization Consultant will provide best practices for creating data-driven hypotheses that answer key business questions.Based on our experience and your analytics, your Optimization Consultant will help you identify optimization opportunities and establish a workflow for collecting and managing input from across your organization.Provided by your SiteSpect Optimization Consultant who understands your business objectives and works with you to achieve your testing goals and increase ROI.Number of hours SiteSpect professional services representatives will work on strategy, creation, or analysis for your optimization program.Enforce an optimization workflow with campaign administrators, builders and read-only roles.Custom integration with 3rd party tools such as Adobe Analytics, Google Analytics, CrazyEgg, Hotjar and more.Build and optimize the customer experience on iOS and Android apps. Build experiences visually, directly on your mobile device, leverage our SPAs or use API only solution.Leverage Custom Variables to capture dimensions about users, such as products purchased, categories viewed and items searched.Isolate users in single Campaigns or allow them in multiple overlapping experiences.Create a unified customer experience by connecting experiences for recognized users across devices.Automate your optimization program through our API: and deploy server-side functionality with on/off switches or progressive rollouts. Leverage cookies, headers or parameters for feature flagging. Test and optimize your CMS, recommendation engine, and other vendor tools.Leverage our SPA SDK to test and optimize your Single Page Application. Support for major frameworks such as Angular, React, and others.Modify the source code of pages on the fly with Regular Expressions, with zero impact to performance. Replace, remove, add in new functionality before pages are rendered in the browser.SiteSpect offers a number of capabilities for effective front-end testing. Use Visual Editor or Regular Expressions to modify source code, support SPA frameworks, define pages for reusability in tests, and minimize performance hits for users and servers.Use point-and-click actions to modify text, images, buttons, promotional banners, and styling. Create, move, rearrange, hide, and track behaviors across channels. Works with SPAs out of the box, such as React and Angular.Push winning Variations to all traffic to benefit early from wins. Push hot fixes your website to quickly resolve issues, to all traffic or segments of users.Respond to real-time alerts and in-product messages to proactively manage your campaigns. Known when a campaign has a winning variation, is hurting conversion, does not have any recent visits, or is disabled.Quickly analyze and understand relevant campaigns and outcomes. Measure conversion, KPIs, user actions, events, conversion funnels, and other key user interactions in our comprehensive dashboard.Personalize the experience for mobile devices, geo location, user types, and user behaviors. Build your own Audiences to align with your key segments of users and leverage your Data Layer.Experience our proxy architecture built from the ground up to avoid flicker and ensure fast experience delivery across desktop, tablet, and mobile devices.Training to get you up and running quickly, includes test building courses & analytics interpretation.Dedicated optimization consultant for strategic and tactical guidance. Your GoLive Report is a success plan to get your team up and running, including website audit, test ideas and optimization roadmap. You will also get ROI (return on investment) modeling backed by Forrester.Depending on which package there are countless tests, segmentations and optimizations within your control across almost any digital touchpoint.Run as many Campaigns as you want.Our optimization experts work with you to recommend 10 impactful test ideas to improve customer experience and impact your bottom line, and build 10 Campaigns so you can quickly benefit from our platform.Directly ingest SiteSpect traffic logs into your monitoring infrastructure to diagnose underperforming applications/servers and identify site errors in near real time.SiteSpect sends a sample of log data to, a log visualization service. This service offers full flexibility to view and analyze logs relating to traffic health and routing. Your network operations center can also use this service to build your own visualization and dashboards or integrate into existing systems.SiteSpect is GDPR Compliant. The General Data Protection Regulation (GDPR) is a legal framework that sets guidelines for the collecting and processing personal information of individuals within or who are citizens of the European Union. More information about SiteSpect’s GDPR support is located on our Customer Notice On EU GDPR Support page.SiteSpect is HIPAA ready, which saves you time when you use SiteSpect in your HIPAA-compliant environment. SiteSpect obfuscates and encrypts visitor behavior and does not store any personal data. SiteSpect also offers on-premise and other deployment models to guarantee personal data never leaves your datacenter.SiteSpect supports Single Sign-On (SSO) authentication through Active Directory and SAML. SSO allows you to centrally manage SiteSpect permissions and login credentials. It also makes it easier for SiteSpect users to quickly log in and switch between their applications saving time and improving productivity.Restrict user access to SiteSpect by IP address.Restrict access to your websites by IP address. Create lists or ranges of IP addresses that allow trusted (whitelisted) users to access your websites or prevent access from disallowed (blacklisted) users.Two-Factor Authentication, also known as 2FA, requires not only a password and username but also something that only a user has access to, such as a token. Using a username and password together with a token makes it harder for potential intruders to gain access to SiteSpect.SiteSpect complies with both the EU-US and the Swiss-US Privacy Shield Frameworks. SiteSpect certifies that it adheres to the Privacy Shield Principles with respect to personal data. More information about SiteSpect’s Privacy Shield support is available on our Business Services Privacy Policy - GDPR and Privacy Shield page.SiteSpect includes a complete history of every user action. Quickly undo changes in the audit history list and audit any change as part of your change management process.SiteSpect maintains the privacy of all customer data by ensuring no test data is exposed and that data is not grouped with or shared with others in any way.SiteSpect leverages Alert Logic to monitor and track security vulnerabilities. This provides you with an additional line of defense as we will notify you of any detected threats or attacks on your website.SiteSpect supports nine different permission levels that provide control and configurable access. Set view and edit permissions on a per user basis for building, managing, and analyzing campaigns.SiteSpect fully supports encryption for all types of in-transit data such as end-user content, SDK and API transmissions, and business user data. We also support testing on HTTP and HTTPS websites.

Building a Culture of Optimization: Planning (Part 1)

January 15, 2013


Whether you have been testing for years or you are just getting started, building a successful optimization program depends on careful planning, implementation, and measurement. This is the first in a three-part series of articles that looks at the steps involved in creating a successful optimization program.

Whether you have been testing for years or you are just getting started, building a successful optimization program depends on careful planning, implementation, and measurement. This is the first in a three-part series of articles that looks at the steps involved in creating a successful optimization program.

In this article, we’ll look at three critical elements in optimization planning:

  1. Forming a Great Testing Team
  2. Getting Your Stakeholders on Board
  3. Writing a Formal Test Plan

Forming a Great Testing Team

John Donne said that “No man is an island” and in testing this is more true than not. Unlike in web analytics where one good analyst can provide great insights, the testing process is typically too political and requires too many resources to be executed alone. Consider what can be involved in making a change to a web site:

  • Someone decides that a change is warranted.
  • Management needs to review the change request, and if approved, initiate the change management process.
  • Depending on the change, developers, designers, marketers, and copywriters may be required.
  • Information Technology needs to deploy the change.
  • Quality Assurance needs to test the change.
  • Analytics needs to validate the change.

Now, compare that to situations where a testing program is in place. Instead of someone deciding a change needs to be made, marketers ask themselves, “what would happen if we changed X, Y, or Z, or even all of them?” While the best testing solutions help to minimize the need for some of the resources required—most commonly developers and IT—there is still a need for a cohesive group to create and run tests, and analyze their results.

Address this need by forming a Testing Team of appropriate resources within your organization. Then give this team a mandate for improvement and allow them to incrementally prove their value and earn the right to test increasingly large projects. Assign your internal super-stars to this team to couple their insights with technology and process capable of measurably demonstrating their brilliance. Give them access to other internal resources, at least as long as they continue to produce results.

The two most important roles on your Testing Team are the project manager and the executive sponsor. The project manager needs to be someone who combines incredible organizational skills with a shocking enthusiasm for change. Their role is to ensure that defined testing processes are followed to the letter, thereby increasingly the likelihood of successful tests. This person does not have to be a jack-of-all-trades, but they have to know Jack (or Jill) to get their job done:

  • The skills to produce a sound statistical design are not required, but the ability to understand basic statistical principles is.
  • The skills to create brilliant design are not required, but the ability to think from the perspective of an end user is, because visitors do not interact with your site the way you think they do.
  • The technical skills to write JavaScript, HTML, or ActionScript are not required, but the ability to keep all resources—technical or otherwise—on task and on time is. Seamlessly juggling people, process, and technology are the hallmarks of an effective project manager.

The executive sponsor’s role is obvious: without an internal champion for change on the management team, most testing projects are dead in the water. Fortunately there is a new class of digitally minded executives who are actively signing up to manage testing projects. These soon-to-be “rock-stars” clearly see the opportunity available and want their names associated with the financial gains that testing so commonly produces. They also recognize the value of using testing to prevent mistakes from happening and are just as happy to report saving the company millions as they are reporting incremental revenue.

Finally, make sure to socialize the Testing Team’s efforts throughout the company. Doing this—essentially announcing to the world your commitment to optimization and demonstrating this commitment by assigning some of your most valuable resources—has a two-fold effect. First, it clarifies to other internal resources why their content is changing in a seemingly random way.

Second, it creates an expectation for the Team to produce and gives them a platform to talk about their successes and failures. Obviously, building and socializing a team like this requires senior management’s support.

Getting Your Stakeholders on Board

Management’s support for testing projects is absolutely critical. Having buy-in from members of the senior management team will make or break testing efforts. Work with these stakeholders from the beginning—in concert with the executive sponsor—and directly solicit their feedback, suggestions, and ideas that can be tested by the newly formed Testing Team.

You might consider establishing a “Multivariate Testing Steering Committee”made up of senior people who are helping to decide what will be tested, when, and how. I recommend socializing the testing program with senior management early on. You will undoubtedly need their support to assemble the Testing Team and will often need budget, approval, or assistance getting testing technology deployed. By approaching management with a clear plan for success, you are far more likely to gain their critical support and validation for your work.

Writing a (Formal) Testing Plan

Companies with highly successful testing and optimization programs have a very formal process for requesting and planning tests. Despite the fact that some in our industry love to proclaim, “Test early, test often, test aggressively,” the reality is that good testing can be quite involved and results are usually commensurate with effort. Absent a structured plan for testing, it is incredibly easy to end up with meaningless data, wasted time, and frustrated internal stakeholders.

Fortunately, developing a test plan is quite simple. Make sure yours answers the following questions:

  1. What is being tested?
  2. Why is it being tested?
  3. What are the expectations for the test?
  4. What are the measures of success for the test?
  5. What are the risks associated with running the test?
  6. What internal resources are required to run the test?
  7. Who is requesting the test?
  8. By when are results needed?

Individually, each of these questions is relatively easy to answer. Some are technical (“what risks are there” and “what resources are required”), some are theoretical (“what are the expectations”), and some are political (“who is requesting” and“by when are results needed?”). The best answers are not page-long explanations; rather, concise explanations designed to help the Testing Team best plan for the deployment of the test.

Most people initially get stuck answering questions three, four, and five. Measures of success and risks associated with testing are important enough issues that they merit their own best practices. Expectations are tough, at least until you start to get the hang of testing, because it is impossible to know ahead of time whether a change will result in a substantial improvement, a small improvement, or a net decline.

Your Testing Team should plan to have a formal testing-planning document ready to go when you start to socialize the group with senior stakeholders. The presence of this document and a few examples of the kind of information you’re looking for will go a long way towards demonstrating that you are serious about testing. Most senior executives have seen enough ad hoc exercises designed to drive incremental improvement during their tenure to appreciate the level of consideration a plan conveys and understand the likelihood of failure in the absence of a testing plan.

Most importantly, requiring a formal test-planning document from anyone in the organization wanting to leverage the Testing Team, including members of the Testing Team themselves, will allow the team to insert tests into a long-term schedule prioritized by opportunity, risk, and political considerations. While I don’t recommend the creation of a timeline so structured that real opportunities will be lost—testing is frequently an opportunistic endeavor, especially when there is a high-level of awareness about testing efforts—having this “roadmap” for testing projects dramatically improves each test’s likelihood for being successfully executed.

Ultimately, the goal for requiring a formal test plan is to drive home an appropriate level of seriousness and rigor about testing in your organization. Especially if your results are similar to the companies interviewed for this research, your successes will breed the desire to create more successes. If any product manager who walks through the door can have his or her test jump the queue with little more than waving of the hands and saying “make the button more blue,” then you are destined to struggle to get your testing program off the ground.

Conversely, if you provide clear guidance about what is required and how the requirements will be evaluated and slotted, at least in our experience, you will soon exceed your expectations and be well on your way to success!

(For more information, download the whitepaper titled “Successful Web Site Testing Practices: Ten Best Practices for Building a World-Class Testing and Optimization Program.”)


Suggested Posts


There’s Really Only One Metric that Matters

weekly roundup graphic.jpg

SiteSpect Synopsis: AI and the Customer Experience

view by visit or user

When to Measure by Visit or by User

Leave a Comment

Your email address will not be published. Required fields are marked *