ab-testing
ab testing
What it does
- Not just "let's see what happens"
- Specific prediction of outcome
- Based on reasoning or data
- Single variable per test
- Otherwise you don't know what worked
- Pre-determine sample size
- Don't peek and stop early
Requirements & configuration
- No flicker, requires dev work
- | No significant difference | Need more traffic or bolder test |
- Status: [implemented / parked / needs follow-up test]
Derived from the skill's own SKILL.md documentation · extracted 2026-07-23
ab-testing FAQ
What does the ab-testing skill do?
When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," "how long should I run this test," "growth experiments," "experiment velocity," "experiment backlog," "ICE score," "experimentation program," or "experiment playbook." Use this whenever someone is comparing two approaches and wants to measure which performs better, or when they want to build a systematic experimentation practice. For tracking implementation, see analytics. For page-level conversion optimization, see cro. Not just "let's see what happens" Specific prediction of outcome
What does ab-testing require?
No flicker, requires dev work | No significant difference | Need more traffic or bolder test | Status: [implemented / parked / needs follow-up test]
How do I install ab-testing?
Run: npx -y skills add https://github.com/coreyhaines31/marketingskills --skill ab-testing --agent claude-code — the source lives at github.com/coreyhaines31/marketingskills.
Maintain ab-testing?
Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.
[](https://getagentictools.com/skills/coreyhaines31-marketingskills-ab-testing?ref=badge) npx agentictools info skills/coreyhaines31-marketingskills-ab-testing The second line is the CLI lookup for this page — handy in READMEs and docs.