send-experiment-designer

1# Send Experiment Designer
2 
3Designs email experiments across four modes and reads them out: a falsifiable hypothesis, a variant matrix that isolates **one** variable per cell, a sample-size / minimum-detectable-effect / run-duration / power plan, and a documented effect/uncertainty read. It may apply an owner-approved precommitted action rule, but statistical output alone never chooses a business action.
4 
5**Mode set (pick one):**
6 
7| Mode | Isolated variable | Primary metric |
8|------|-------------------|----------------|
9| `a-b` | one change — subject *or* preheader *or* CTA *or* creative | open (subject) / click / CTOR (CTA/creative) |
10| `multivariate` | 2+ factors crossed (e.g. subject × CTA), one variable per cell | the goal metric, powered per cell |
11| `send-time` | deploy hour/day; subject, segment, creative held constant | same-window engagement (open/click) |
12| `hold-out` | send vs no-send (randomized control receives nothing / current default) | conversion or revenue-per-recipient (incremental lift) |
13 
14Default the mode from the request when it is unambiguous (e.g. "test two subject lines" → `a-b`, "best hour to send" → `send-time`, "measure incremental revenue" → `hold-out`); state the picked mode back and proceed.
15…