Sticky Bucketing in Logged-Out SaaS A/B Tests
If the same visitor sees variant A on Monday and variant B on Wednesday, your A/B testing efforts are not measuring behavior. They are measuring confusion.
Read Article→
Free Learning · Better Decisions Make Growth Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical guides for analysts, growth teams, and founders.
A/B Testing Seasonality for B2B SaaS Teams
I have seen teams ship the wrong variant because week three landed on quarter end, and buyers stopped moving. The test looked clean, but the revenue impact
Read Article→
Server-Side vs Client-Side Testing in B2B SaaS
Most teams pick an A/B testing method based on who can ship faster this sprint. That is how bad bets get dressed up as experimentation.
Read Article→
Survival Analysis SaaS: Managing Tests With Delayed Revenue
You ran the test. Signups moved. Activation moved. Revenue did not. At least not yet. This is where many SaaS teams make an expensive mistake.
Read Article→
CUPAC Explained for Low-Traffic SaaS Teams
Most low-traffic SaaS teams do not have a testing problem. They have a waiting problem. If you only get a few thousand meaningful users a month, a clean
Read Article→
Switchback Experiments in SaaS With Network Effects
Most bad product tests don't fail because the idea was weak. They fail because the test assigned treatment to the wrong unit.
Read Article→
Cookie Consent Bias in A/B Tests, and How I Correct It
Your test can look clean and still be wrong. If analytics starts only after consent, you are not measuring visitors. You are measuring the subset willing
Read Article→
Cluster Randomized Tests for B2B SaaS Accounts
When I review a B2B SaaS test plan, I start with one question: can people inside the same account affect each other? If the answer is yes, user-level A/B
Read Article→
How I Handle Revenue Outliers in A/B Tests
A test can look like a winner because three customers showed up with a corporate card. I've seen teams ship bad changes, celebrate the lift, then spend a
Read Article→
Experiment Naming Conventions for Search and Reporting
If your team can't find a winning test in 30 seconds, the name is broken. I care about experiment naming conventions because I've watched bad names slow
Read Article→
SaaS Checkout Optimization: A/B Tests That Cut Friction
Most SaaS checkouts do not fail because the buyer suddenly stops wanting the product. They fail at the last minute when doubt beats momentum, which is why
Read Article→
Ratio Metrics in A/B Testing Without Misreading Revenue Lift
A test can lift conversion and still hurt revenue. I have watched teams ship winners that looked great in the dashboard but weak in the finance review.
Read Article→
Triggered Analysis for SaaS A/B Tests With Partial Exposure
You can run a clean test and still make the wrong call. I see it all the time in SaaS. The experiment is randomized, the stats look fine, and the
Read Article→
Exposure Logging Attribution Makes A/B Test Results Trustworthy
Most bad A/B test calls are not statistics problems. They are measurement problems. I see the same mistake over and over.
Read Article→
The Decision Latency Metric for Experimentation Teams
A test doesn't create value when the chart turns green. It creates value when somebody decides. I've seen teams run clean experiments, get solid analytics,
Read Article→
Activation Metrics: How to Pick the One That Predicts Retention
Most teams track the wrong activation metric. A practitioner's guide to choosing an activation metric that statistically predicts retention, instrumenting…
Read Article→
How to Write A/B Test Hypotheses That Actually Hold Up
A practitioner's guide to writing A/B test hypotheses — the structure that survives review, the three failure modes that produce inconclusive tests, and how…
Read Article→
Regression to the Mean: Why A/B Test Wins Fade After Launch
The most dangerous SaaS test win is the one that looks clean, gets shipped fast, and fades a month later. I've seen teams forecast revenue off a headline
Read Article→
The Commitment Trap: Why Forcing Users to Opt-In Destroys Conversions (and What Loss Aversion Actually Predicts)
An experiment requiring users to actively opt-in to autopay during plan selection caused a 15-20% drop in conversions.
Read Article→
The Six-Figure Decision: How Strategic Price De-Emphasis Reveals the True Economics of Attention
When a consumer subscription business reduced the visual prominence of pricing during a high-price market period, conversions jumped 12-15% and generated…
Read Article→
Behavioral Economics in Marketing: 10 Tactics Tested
Behavioral economics in marketing works best as hypothesis generation. Examine 10 tactics, their evidence, failure conditions, and what marketers should test.
Read Article→
7 Real-World Examples of the Door-in-the-Face Technique (And When It Backfires)
Real examples of the door-in-the-face technique in marketing and sales - how the contrast principle drives compliance, and when the tactic backfires.
Read Article→
Retail A/B Testing Isn't Broken — Your Prioritization Is
Walk into most retail optimization programs and you'll find the same thing: a backlog of tests that all feel urgent, a dashboard celebrating win rates that
Read Article→
The Retail Experiment That Most Stores Are Running Wrong
Walk the floor of almost any retail operation running A/B tests, and you'll notice the same pattern: the tests are neat, the hypotheses are tidy, and the
Read Article→
Better Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical decision guides for analysts, growth teams, and founders. Free. Weekly.
Opens Substack to confirm your subscription · Free · Unsubscribe anytime