Category Archives: Uncategorized

12 years on the mountain: How the questions have changed (but the math hasn’t)

In the world of experimentation, if you find a ‘winning variation’, you iterate (and improve). This is why Conductrics is heading back to Superweek for the 12th time in 2026. We began in 2015 as attendees and became a proud sponsor along the way. We return for more than the content; we return because it […]

| Leave a comment


Interpretable Machine Learning and Contextual Bandits

At Conductrics we believe that intentional use of machine learning and contextual multi-armed bandits (MAB) often requires human interpretability. Why?1) Compliance – in many environments it is important to insure that policies are followed about how and when different people get offered different experiences. In order to ensure compliance with those policies/regulations (for example see […]

Also posted in Experimentation, Predictive Learning, Privacy by Design | | Leave a comment


CUPED’s Sting: More Power More Underpowered A/B Tests

The benefit of using Regression Adjustment (CUPED) for A/B Testing is that in certain cases it can increase the precision of the experiment’s results.  However, if one isn’t intentional in the design and set up, this more powerful approach can easily lead to underpowered experiments. What is Regression Adjustment/CUPED One can think of regression adjustment/CUPED […]

Also posted in Experimentation | | Leave a comment


The A/B Testing Industry: Why Attitudes Matter

At Conductrics, we enable companies to run A/B and MVT experiments, optimize campaigns with contextual bandit technology, and provide relevant customer experience and insights through our A/B Survey technology.  However, as great as our technology is, ultimately we believe that the overarching value of any experimentation program is in how it provides a principled procedure […]

Also posted in Experimentation, Implementation, Privacy by Design | | Leave a comment


Adjusted Power Multi-Armed Bandit

At Conductrics, two of our guiding principles for experimentation are:Principle 1: Be mindful about what the problem is, preferring the simplest approach to solving it. Principle 2: Remember that how data is collected is often much more important than how that data is analyzed. Often, in the pursuit of ‘velocity’ and ‘scale’, the market will […]

Also posted in Experimentation, Predictive Learning | | Leave a comment


Experimentation and Privacy by Design

The Value in Being Intentional and Customer Focused Privacy in analytics is often considered a constraint or a barrier that limits our actions or our ability to develop powerful technological solutions. However, embedding privacy by design principles—such as data minimization—actually enhances our systems and software. Why? Because it aligns with our field’s primary value proposition: […]

Also posted in Experimentation, Privacy by Design | | Leave a comment


Privacy Engineering in AB Testing

Conductrics takes privacy seriously. Conductrics AB Testing has been developed in conformance with Privacy by Design principles in order to give our clients the privacy options they need. This is important for: 1) maintaining customer trust by safeguarding their privacy; and 2) in order to comply with privacy regulations that require systems to be designed […]

Also posted in Experimentation, Privacy by Design | | Leave a comment


Introducing Conductrics Market Research

The Fusion of Experimentation with Market Research Customer centric  For over a decade Conductrics has been providing innovative software for online Experimentation and Optimization. Innovations include the industry’s first API driven A/B Testing and multiarmed bandit software, as well as the first to introduce transparency in our machine learning predictive targeting with human-interpretable contextual bandits […]

Also posted in Experimentation, Survey | | Leave a comment


Conductrics Market Research Features

A First Look In this post we will take our first look at some of the new features the Conductrics Market Research release. We will follow up over the coming weeks and months with more peeks and details of the new capabilities.  As we roll out the new integrated platform, customers will gain access to […]

Also posted in Experimentation, Privacy by Design | | Leave a comment


AB Testing: Ruling Out To Conclude

Seemingly simple ideas underpinning AB Testing are confusing. Rather than getting into the weeds around the definitions of p-values and significance, perhaps AB Testing might be easier to understand if we reframe it as a simple ruling out procedure. Ruling Out What? There are two things we are trying to rule out when we run […]

Also posted in Experimentation | | Leave a comment