Understanding Experimentation Platforms

This document was uploaded by one of our users. The uploader already confirmed that they had the permission to publish it. If you are author/publisher or own the copyright of this documents, please report to us by using this DMCA report form.

Simply click on the Download Book button.

Yes, Book downloads on Ebookily are 100% Free.

Sometimes the book is free on Amazon As well, so go ahead and hit "Search on Amazon"

Author(s): Adil Aijaz, Trevor Stuart, Henry Jewkes
Edition: First
Publisher: O'Reilly Media, Inc.
Year: 2018

Language: English
Pages: 30

Cover
Split Software
Copyright
Table of Contents
Foreword: Why Do Great Companies Experiment?
Creating User/Customer-Centric Products
Business Strategic
Talent Empowering
Chapter 1. Introduction
Chapter 2. Building an Experimentation Platform
Targeting Engine
Telemetry
Statistics Engine
Management Console
Chapter 3. Designing Metrics
Types of Metrics
Overall Evaluation Criteria
Feature Metrics
Guardrail Metrics
Debugging Metrics
Metric Frameworks
HEART Metrics
Tiered Metrics
Chapter 4. Best Practices
Running A/A Tests
Understanding Power Dynamics
Executing an Optimal Ramp Strategy
Building Alerting and Automation
Chapter 5. Common Pitfalls
Sample Ratio Mismatch
Simpson’s Paradox
Twyman’s Law
Rate Metric Trap
Chapter 6. Conclusion
About the Authors