Run an experiment
Run an experiment fixes its threshold and sample before it starts, holds a control arm, and ends in one recorded Decision.
Trigger
Runs on Experiment.created. Part of Experimentation, run by the Marketing Team.
Steps
- State the Hypothesis as a Metric, a baseline, and a threshold.
- Fix the sample size before the start.
- Split traffic between a control arm and a test arm with a Flag.
- Read the result only at the fixed sample.
- Record the Decision: ship, iterate, or drop.
Outputs
Example
An Experiment tests a $39 Price against $49 with 2,000 Visitors per arm. At the fixed sample, $49 wins, and the Decision records ship.