Author Archives: Matt Gershoff
Interpretable Machine Learning and Contextual Bandits
At Conductrics we believe that intentional use of machine learning and contextual multi-armed bandits (MAB) often requires human interpretability. Why?1) Compliance – in many environments it is important to insure that policies are followed about how and when different people get offered different experiences. In order to ensure compliance with those policies/regulations (for example see […]
CUPED’s Sting: More Power More Underpowered A/B Tests
The benefit of using Regression Adjustment (CUPED) for A/B Testing is that in certain cases it can increase the precision of the experiment’s results. However, if one isn’t intentional in the design and set up, this more powerful approach can easily lead to underpowered experiments. What is Regression Adjustment/CUPED One can think of regression adjustment/CUPED […]
Posted in Experimentation, Uncategorized
Leave a comment
The A/B Testing Industry: Why Attitudes Matter
At Conductrics, we enable companies to run A/B and MVT experiments, optimize campaigns with contextual bandit technology, and provide relevant customer experience and insights through our A/B Survey technology. However, as great as our technology is, ultimately we believe that the overarching value of any experimentation program is in how it provides a principled procedure […]
Adjusted Power Multi-Armed Bandit
At Conductrics, two of our guiding principles for experimentation are:Principle 1: Be mindful about what the problem is, preferring the simplest approach to solving it. Principle 2: Remember that how data is collected is often much more important than how that data is analyzed. Often, in the pursuit of ‘velocity’ and ‘scale’, the market will […]
Experimentation and Privacy by Design
The Value in Being Intentional and Customer Focused Privacy in analytics is often considered a constraint or a barrier that limits our actions or our ability to develop powerful technological solutions. However, embedding privacy by design principles—such as data minimization—actually enhances our systems and software. Why? Because it aligns with our field’s primary value proposition: […]
Posted in Experimentation, Privacy by Design, Uncategorized
Leave a comment
Privacy Engineering in AB Testing
Conductrics takes privacy seriously. Conductrics AB Testing has been developed in conformance with Privacy by Design principles in order to give our clients the privacy options they need. This is important for: 1) maintaining customer trust by safeguarding their privacy; and 2) in order to comply with privacy regulations that require systems to be designed […]
Posted in Experimentation, Privacy by Design, Uncategorized
Leave a comment
Introducing Conductrics Market Research
The Fusion of Experimentation with Market Research Customer centric For over a decade Conductrics has been providing innovative software for online Experimentation and Optimization. Innovations include the industry’s first API driven A/B Testing and multiarmed bandit software, as well as the first to introduce transparency in our machine learning predictive targeting with human-interpretable contextual bandits […]
Posted in Experimentation, Survey, Uncategorized
Leave a comment
Conductrics Market Research Features
A First Look In this post we will take our first look at some of the new features the Conductrics Market Research release. We will follow up over the coming weeks and months with more peeks and details of the new capabilities. As we roll out the new integrated platform, customers will gain access to […]
Posted in Experimentation, Privacy by Design, Uncategorized
Leave a comment
AB Testing: Ruling Out To Conclude
Seemingly simple ideas underpinning AB Testing are confusing. Rather than getting into the weeds around the definitions of p-values and significance, perhaps AB Testing might be easier to understand if we reframe it as a simple ruling out procedure. Ruling Out What? There are two things we are trying to rule out when we run […]
Posted in Experimentation, Uncategorized
Leave a comment
Some are Useful: AB Testing Programs
As AB testing becomes more commonplace, companies are moving beyond thinking about how to best run experiments to how to best set up and run experimentation programs. Unless the required time, effort, and expertise is invested into designing and running the AB Testing program, experimentation is unlikely to be useful. Interestingly, some of the best […]
Posted in Experimentation, Uncategorized
Leave a comment
Interpretable Machine Learning and Contextual Bandits
At Conductrics we believe that intentional use of machine learning and contextual multi-armed bandits (MAB) often requires human interpretability. Why?1) Compliance – in many environments it is important to insure that policies are followed about how and when different people get offered different experiences. In order to ensure compliance with those policies/regulations (for example see […]
CUPED’s Sting: More Power More Underpowered A/B Tests
The benefit of using Regression Adjustment (CUPED) for A/B Testing is that in certain cases it can increase the precision of the experiment’s results. However, if one isn’t intentional in the design and set up, this more powerful approach can easily lead to underpowered experiments. What is Regression Adjustment/CUPED One can think of regression adjustment/CUPED […]
Posted in Experimentation, Uncategorized
Leave a comment
The A/B Testing Industry: Why Attitudes Matter
At Conductrics, we enable companies to run A/B and MVT experiments, optimize campaigns with contextual bandit technology, and provide relevant customer experience and insights through our A/B Survey technology. However, as great as our technology is, ultimately we believe that the overarching value of any experimentation program is in how it provides a principled procedure […]
Adjusted Power Multi-Armed Bandit
At Conductrics, two of our guiding principles for experimentation are:Principle 1: Be mindful about what the problem is, preferring the simplest approach to solving it. Principle 2: Remember that how data is collected is often much more important than how that data is analyzed. Often, in the pursuit of ‘velocity’ and ‘scale’, the market will […]
Experimentation and Privacy by Design
The Value in Being Intentional and Customer Focused Privacy in analytics is often considered a constraint or a barrier that limits our actions or our ability to develop powerful technological solutions. However, embedding privacy by design principles—such as data minimization—actually enhances our systems and software. Why? Because it aligns with our field’s primary value proposition: […]
Posted in Experimentation, Privacy by Design, Uncategorized
Leave a comment
Privacy Engineering in AB Testing
Conductrics takes privacy seriously. Conductrics AB Testing has been developed in conformance with Privacy by Design principles in order to give our clients the privacy options they need. This is important for: 1) maintaining customer trust by safeguarding their privacy; and 2) in order to comply with privacy regulations that require systems to be designed […]
Posted in Experimentation, Privacy by Design, Uncategorized
Leave a comment
Introducing Conductrics Market Research
The Fusion of Experimentation with Market Research Customer centric For over a decade Conductrics has been providing innovative software for online Experimentation and Optimization. Innovations include the industry’s first API driven A/B Testing and multiarmed bandit software, as well as the first to introduce transparency in our machine learning predictive targeting with human-interpretable contextual bandits […]
Posted in Experimentation, Survey, Uncategorized
Leave a comment
Conductrics Market Research Features
A First Look In this post we will take our first look at some of the new features the Conductrics Market Research release. We will follow up over the coming weeks and months with more peeks and details of the new capabilities. As we roll out the new integrated platform, customers will gain access to […]
Posted in Experimentation, Privacy by Design, Uncategorized
Leave a comment
AB Testing: Ruling Out To Conclude
Seemingly simple ideas underpinning AB Testing are confusing. Rather than getting into the weeds around the definitions of p-values and significance, perhaps AB Testing might be easier to understand if we reframe it as a simple ruling out procedure. Ruling Out What? There are two things we are trying to rule out when we run […]
Posted in Experimentation, Uncategorized
Leave a comment
Some are Useful: AB Testing Programs
As AB testing becomes more commonplace, companies are moving beyond thinking about how to best run experiments to how to best set up and run experimentation programs. Unless the required time, effort, and expertise is invested into designing and running the AB Testing program, experimentation is unlikely to be useful. Interestingly, some of the best […]
Posted in Experimentation, Uncategorized
Leave a comment