Regression to the Mean in A/B Tests: A Practical Guide
A plain-English guide to why selected extreme A/B test results often shrink, and why no universal discount can recover the true effect.
Read Article→
Free Learning · Better Decisions Make Growth Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical guides for analysts, growth teams, and founders.
Early Stopping in A/B Tests: A Complete Guide for New CRO Analysts
How outcome-dependent stopping changes A/B test error rates, why there is no universal peeking multiplier, and how to precommit a valid stopping rule.
Read Article→
Pricing Page Anatomy: Why Your Decoy Probably Doesn't Work
The standard 3-tier pricing-page playbook — anchor + decoy + "Most Popular" badge — works under specific conditions. Here are the ones that break.
Read Article→
Bright Patterns: The Ethical Alternative to the Dark Pattern Catalog
Dark patterns optimize for the next quarter. Bright patterns optimize for the next decade. The 12 alternatives, and why your A/B test will misjudge them.
Read Article→
Dark Patterns: The 12-Pattern Taxonomy and What They Cost Your Brand
Princeton found dark patterns on 11% of shopping sites. The FTC, EU, and California now regulate them. The 12-pattern taxonomy and what each costs you.
Read Article→
The Modern Don't Make Me Think Stack: Usability for 2026
Krug's usability principles still hold — but the cost of misapplying them now compounds in places dashboards cannot see. The complete Krug-2026 reading list.
Read Article→
Above-the-Fold CTA Hierarchy: How Many CTAs Is Too Many?
A practical framework for deciding which above-the-fold CTAs serve distinct intent and which create competition worth testing.
Read Article→
Click-to-Conversion Ratio: The CTA Diagnostic Most Teams Ignore
Use click-to-conversion ratios to find wrong-intent clicks, destination friction, and cannibalization hidden by aggregate CTA reports.
Read Article→
CTA Cannibalization: When a Small Lift Hides a Net Loss
Use placement-level conversion and source intent to test whether a directional CTA result is genuinely additive or cannibalized.
Read Article→
Copy Intent vs Visual Prominence: Why "Sign Up" Doesn't Mean "Shop"
Separate CTA visibility from intent match by comparing click-through, destination completion, and source-page context together.
Read Article→
Inside a Large A/B Test Ledger: What CRO at Scale Looks Like
Lessons from a historical enterprise testing ledger, with explicit limits on the denominator and no universal win-rate or device-performance benchmark.
Read Article→
Mobile vs Desktop CTA Asymmetry: When the Same Test Tells Two Stories
How pre-specified mobile and desktop analysis can reveal heterogeneous CTA effects without claiming that device segmentation universally raises win rates.
Read Article→
Time-on-Page as a Friction Signal: When Faster Is Actually Better
Interpret time-on-page with conversion, scroll depth, and interaction data to separate faster decisions from abandonment or confusion.
Read Article→
Trust Badges: Why Ambiguity Can Be Worse Than Absence
Use behavioral diagnostics and explanatory content to test whether a benefit badge reduces uncertainty or adds friction.
Read Article→
The A/B Testing Mistake That Feels Like Progress
Most teams discover A/B testing and immediately want to run more experiments. The logic seems sound: more tests mean more data, more data means better
Read Article→
'Not Significant' Doesn't Mean Your A/B Test Failed — It Means You're Uncertain
The most expensive misreading in A/B testing is treating 'not statistically significant' as 'no difference.' It actually means 'we didn't collect enough…
Read Article→
The Automation Trap: Why AI Won't Fix Your A/B Testing Culture
There's a pattern worth noticing every time a new category of "automated optimization" software launches: the marketing promises to replace the hard
Read Article→
The AI A/B Testing Promise Has a Behavioral Science Problem
Every few months, a new platform promises to automate conversion optimization. The pitch is always the same: remove the human bottleneck, run more tests
Read Article→
Adaptive Algorithms vs. Fixed-Sample A/B Tests: Why I Changed How I Run Experiments
After 100+ experiments per year, fixed-sample A/B testing's opportunity cost became impossible to ignore.
Read Article→
A/B Test Repository Architecture
A/B test repositories don't fail because the schema is wrong. They fail because nobody can find what they need fast enough.
Read Article→
A/B Testing Documentation Framework
The point of documenting experiments isn't to record what happened. It's to make the next similar hypothesis sharper.
Read Article→
How to Avoid Repeating Failed Experiments: The Failure Recurrence Rate
Repeated failed experiments aren't a sign of ambition — they're a sign your team isn't reading its own archive.
Read Article→
Best A/B Test Library Software: The Tool Fit Matrix for Evaluation
The best A/B testing platform isn't a single tool — it's the one that fits your team's scale, statistical needs, integration stack, and cost curve.
Read Article→
Centralized A/B Testing Database Design: The Trace Ratio That Predicts Program Health
A centralized A/B testing database is only as useful as the fraction of experiments you can fully reconstruct.
Read Article→
Better Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical decision guides for analysts, growth teams, and founders. Free. Weekly.
Opens Substack to confirm your subscription · Free · Unsubscribe anytime