ab-testing

ab testing

coreyhaines31 ↓ 35k
Claude Code
View source ↗

What it does

  • Not just "let's see what happens"
  • Specific prediction of outcome
  • Based on reasoning or data
  • Single variable per test
  • Otherwise you don't know what worked
  • Pre-determine sample size
  • Don't peek and stop early

Requirements & configuration

  • No flicker, requires dev work
  • | No significant difference | Need more traffic or bolder test |
  • Status: [implemented / parked / needs follow-up test]

Derived from the skill's own SKILL.md documentation · extracted 2026-07-23

ab-testing FAQ

What does the ab-testing skill do?

When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," "how long should I run this test," "growth experiments," "experiment velocity," "experiment backlog," "ICE score," "experimentation program," or "experiment playbook." Use this whenever someone is comparing two approaches and wants to measure which performs better, or when they want to build a systematic experimentation practice. For tracking implementation, see analytics. For page-level conversion optimization, see cro. Not just "let's see what happens" Specific prediction of outcome

What does ab-testing require?

No flicker, requires dev work | No significant difference | Need more traffic or bolder test | Status: [implemented / parked / needs follow-up test]

How do I install ab-testing?

Run: npx -y skills add https://github.com/coreyhaines31/marketingskills --skill ab-testing --agent claude-code — the source lives at github.com/coreyhaines31/marketingskills.

Maintain ab-testing?

Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.

ab-testing on getagentictools
[![ab-testing on getagentictools](https://getagentictools.com/badge/skills/coreyhaines31-marketingskills-ab-testing.svg)](https://getagentictools.com/skills/coreyhaines31-marketingskills-ab-testing?ref=badge)
npx agentictools info skills/coreyhaines31-marketingskills-ab-testing

The second line is the CLI lookup for this page — handy in READMEs and docs.