# Slide Outline: Experimental Design Workshop

## 1. Workshop Goal

- Turn one experiment idea into a review-ready design memo.
- End with a causal question, estimand, metrics, guardrails, validity checks, and decision rule.

## 2. Why Experiments Fail Before Analysis

- The decision is unclear.
- The randomization unit does not match interference.
- The primary metric is chosen after looking.
- Guardrails are missing.

## 3. The Design Memo

- Decision context
- Treatment and control
- Population and exposure
- Primary metric and guardrails
- Minimum worthwhile effect
- Validity checks

## 4. Team Exercise

- Pick one decision.
- Draft the causal question.
- Name the randomization unit.
- Write one ship/no-ship decision rule.

## 5. Peer Critique

- What would invalidate the experiment?
- What would make a statistically significant result not worth shipping?
- Which guardrail would stop the rollout?

## 6. Close

- One revision each team made after critique.
- One unresolved risk to resolve before launch.
