Skills for Real Engineers. Straight from my .agents directory.
ad-test-designer
Agent skill fromaaron-he-zhu/aaron-marketing-skills
Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants — use ad-creative-builder; not for reading back one shipped change — use paid-measurement-loop. 广告AB测试设计/实验设计/显著性判定/增效测试
How to install ad-test-designer
npx skills add aaron-he-zhu/aaron-marketing-skills# or add only this skill to Claude Code: copy the folder
ad/orchestrate/ad-test-designer/
# into
~/.claude/skills/ad-test-designer/ (all projects)
.claude/skills/ad-test-designer/ (one project)
1# Ad Test Designer23Designs paid-ad creative/landing A/B/n and incrementality tests and reads them out: hypothesis, variant matrix, sample-size/duration/power plan, effect size, uncertainty, practical-effect status, and guardrail state. This skill owns **experiment design + statistical interpretation**. It may apply an owner-approved, precommitted action rule, but it never treats a p-value or helper output as an automatic business decision. It does not produce variants (`ad-creative-builder`), read back one already-shipped change (`paid-measurement-loop`), or do cross-channel reporting (`performance-analyzer`).45## Quick Start67```text8Design an A/B test for two landing-page hero variants. Baseline CVR is 3%, I want to detect a 15% lift. Goal is DR.9```10```text11I have 4 RSA creative variants to test on a prospecting set. Build the variant matrix, sample size, and run duration.12```13```text14Here's my finished test results CSV (variant, sessions, conversions). Is the winner significant — promote or kill?15```1617## Skill Contract1819- **Expected output**: a test design (hypothesis, variant matrix, immutable test/variant/measurement binding, primary/secondary/guardrail metrics, sample-size + duration + power plan) **and/or** a read-out bound to that exact design (effect estimate, interval, statistical flag, practical-effect flag, guardrails, and either an owner-governed recommendation or `decision: UNDECIDED`).20…
Excerpt shown under the repository's Apache-2.0 license.
More skills in aaron-marketing-skills
Similar skill repositories
An agentic skills framework & software development methodology that works.
Public repository for Agent Skills
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
An AI skill that provides design intelligence for building professional UI/UX across multiple platforms.
Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More
