Tooluck logoTooluck
SKILL.md

ad-test-designer

Agent skill fromaaron-he-zhu/aaron-marketing-skills

Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants — use ad-creative-builder; not for reading back one shipped change — use paid-measurement-loop. 广告AB测试设计/实验设计/显著性判定/增效测试

How to install ad-test-designer

install ad-test-designer
# install the aaron-marketing-skills pack with the skills CLI
npx skills add aaron-he-zhu/aaron-marketing-skills

# or add only this skill to Claude Code: copy the folder

ad/orchestrate/ad-test-designer/

# into

~/.claude/skills/ad-test-designer/ (all projects)

.claude/skills/ad-test-designer/ (one project)

ad/orchestrate/ad-test-designer/SKILL.md

Apache-2.0Full file
1# Ad Test Designer
2
3Designs paid-ad creative/landing A/B/n and incrementality tests and reads them out: hypothesis, variant matrix, sample-size/duration/power plan, effect size, uncertainty, practical-effect status, and guardrail state. This skill owns **experiment design + statistical interpretation**. It may apply an owner-approved, precommitted action rule, but it never treats a p-value or helper output as an automatic business decision. It does not produce variants (`ad-creative-builder`), read back one already-shipped change (`paid-measurement-loop`), or do cross-channel reporting (`performance-analyzer`).
4
5## Quick Start
6
7```text
8Design an A/B test for two landing-page hero variants. Baseline CVR is 3%, I want to detect a 15% lift. Goal is DR.
9```
10```text
11I have 4 RSA creative variants to test on a prospecting set. Build the variant matrix, sample size, and run duration.
12```
13```text
14Here's my finished test results CSV (variant, sessions, conversions). Is the winner significant — promote or kill?
15```
16
17## Skill Contract
18
19- **Expected output**: a test design (hypothesis, variant matrix, immutable test/variant/measurement binding, primary/secondary/guardrail metrics, sample-size + duration + power plan) **and/or** a read-out bound to that exact design (effect estimate, interval, statistical flag, practical-effect flag, guardrails, and either an owner-governed recommendation or `decision: UNDECIDED`).
20…

Excerpt shown under the repository's Apache-2.0 license.

More skills in aaron-marketing-skills

Keep exploring

Similar skill repositories

thedotmack /

claude-mem
116k

Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More

CCCXGHGM+135 skills

Newsletter

Join the Community

Subscribe to our newsletter for the latest news and updates