Learn how to design, measure and implement trustworthy A/B tests from leading experimentation expert Ronny Kohavi (ex-Amazon, Airbnb, Microsoft)

The ability to conduct reliable A/B tests is a major advantage for businesses ranging from consumer apps to manufacturing, with a wide array of applications. Whether you’re trying to optimize web traffic, trial a new feature, or test the effects of changes in a marketplace, A/B testing can help you confidently make critical business decisions faster. 

Some businesses rely only on observational analysis to make decisions when they don’t have the expertise to conduct rigorous experiments. However, it’s better for your teams and the business to upskill in experimentation and be on the cutting edge of tools and methodologies. Setting up and running A/B tests isn’t always straightforward, and you need to be certain that the results are reliable. 

Leading expert Ronny Kohavi, drawing from his 20+ years of experience, will walk you through the ins and outs of experimentation, identifying key insights and working through live demos in his live course, Accelerating Innovation with A/B Testing, starting January 30th. 

Ronny has extensive industry experience having laid the foundation of modern online experimentation at tech giants such as Amazon, Microsoft and Airbnb. Ronny co-authored the book Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing (with Diane Tang and Ya Xu) which is in the top-10 data mining books on Amazon. He is the most viewed writer on Quora’s A/B testing and he received the Individual Lifetime Achievement Award for Experimentation Culture in September 2020.

Over the course of 5 two-hour sessions with Ronny, you will work through:

• The fundamentals of A/B testing (e.g. causality, surprising examples, experimentation platforms, metrics, interpreting results, trust and pitfalls, Twyman’s law, and A/A tests)
• Addressing cultural challenges, humbling results (e.g., failing often, pivoting, iterating), institutional memory and meta-analysis, and ethics
• Case studies from companies like Airbnb and Bing
• Other topics including the Hierarchy of evidence, Expected Value of Information (EVI), complementary techniques, and risks in observational causal studies

Unlike other online learning platforms like Udemy, Coursera or Linkedin, Sphere allows learners to work with Ronny live — both in sessions and during office hours — to improve their experimentation skills. In addition, you’ll be able to learn from and network with other top-tier practitioners in the industry. 

Since the course is also fully accredited, you can likely expense the course using your L&D budget. We also offer discounts for groups/teams - feel free to email leah@getsphere.com for more details.