ab-test-analysis
An agent skill by phuryn, from phuryn/pm-skills. Tags: automation, spreadsheets, trend-analysis, web.
What it does
Analyze A/B test results with statistical significance, sample size validation, confidence intervals, and ship/extend/stop recommendations. Use when evaluating experiment results, checking if a test reached significance, interpreting split test data, or deciding whether to ship a variant.
Install
With the skills CLI, which installs into Claude Code, Codex, Cursor and other agents:
npx skills add phuryn/pm-skills --skill ab-test-analysisOr copy the skill folder into Claude Code's skills directory by hand (~/.claude/skills for every project, or .claude/skills inside one):
git clone --depth 1 https://github.com/phuryn/pm-skills
cp -r pm-skills/pm-data-analytics/skills/ab-test-analysis ~/.claude/skills/ab-test-analysisSafety box score
Not rated yet. A safety box score grades what a skill and its scripts can reach on the machine of whoever installs it, across eight categories from shell execution to secrets access. Anyone can request one from this page; it is saved for everyone. How the score works.
Source
- Repository
- phuryn/pm-skills (all skills from this repository)
- Path
- pm-data-analytics/skills/ab-test-analysis/SKILL.md
- Branch
- main
- Updated
- 2026-09-19
Related skills
- cohort-analysis — Perform cohort analysis on user engagement data — retention curves, feature adoption trends, and segment-level insights.
- sentiment-analysis — Analyze user feedback data to identify segments with sentiment scores, JTBD, and product satisfaction insights.
- growth-loops — Identify growth loops (flywheels) for sustainable traction. Evaluates 5 loop types: Viral, Usage, Collaboration, User-Generated, and Referral.
- user-segmentation — Segment users from feedback data based on behavior, JTBD, and needs. Identifies at least 3 distinct user segments.
- aws-blocks — Guides building full-stack applications with AWS Blocks — an Infrastructure-from-Code framework.
- chrome-mcp-troubleshooting — Diagnose and fix Claude in Chrome MCP extension connectivity issues.