CUPED Variance Reduction in A/B Testing, Explained
How CUPED uses pre-experiment data to cut A/B test duration by 20–50%, where it works (and where it doesn't), and how to start using it.
Know what to test, when to trust the result, and what to do next. Practical guides for analysts, growth teams, and founders.
How CUPED uses pre-experiment data to cut A/B test duration by 20–50%, where it works (and where it doesn't), and how to start using it.
A practical guide to A/B testing across the e-commerce funnel — from category pages to checkout.
Learn why aggregate A/B test results hide the truth. Master segmentation analysis, understand heterogeneous treatment effects, and avoid the segment fishing trap.
Canary releases, feature flags, and A/B tests solve different problems. When to use each — and why a 10% rollout is not an experiment.
From Obama's $60M fundraising lift to modern campaign optimization, political A/B testing is a masterclass in high-stakes, time-constrained experimentation…
A/B testing isn't free. Learn the real costs — opportunity cost, engineering resources, decision delay — and develop the judgment to know when shipping fast…
Learn how to test pricing without the ethical and brand risks of showing different prices to different users.
Standard A/B testing breaks when users influence each other. Learn about interference, network effects, and how platforms like LinkedIn and Uber solve…
A/B tests, multivariate tests, and bandit algorithms each solve different problems.
Generic onboarding flows force diverse users through identical experiences, losing those who don't see immediate relevance.
Empty states are the most overlooked conversion opportunity in product design.
Social proof during onboarding transforms uncertain new users into confident adopters.
The first 5 minutes of product usage determine whether users become power users or churned statistics.
Front-loading your entire product's complexity into the first session is the fastest way to lose users.
Time-to-value is the hidden variable that determines whether users activate or abandon.
The ultimate product goal is not just activation but habit formation. Learn how behavioral psychology's habit loop, variable rewards, and identity…
Onboarding checklists exploit deep psychological patterns around task completion, the Zeigarnik effect, and endowed progress.
Trace A/B testing from 1835 drug trials through Claude Hopkins' coupon testing to Google running 10,000 experiments annually.
Not all A/B tests use the same statistics. Learn which test to use for conversion rates, revenue, count data, and small samples — with a practical decision tree.
Nobel laureate Robert Shiller's concept of narrative economics reveals that stories, not data, drive economic behavior.
Most companies treat positioning as a creative exercise. The smartest ones treat it as an experimental science.
Most companies obsess over differentiation while neglecting distinctiveness.
Explore why the choice between creating a new market category and entering an existing one is the most consequential strategic decision a company makes, and…
Corporate brand accounts struggle to generate engagement while founder-led content thrives.
Know what to test, when to trust the result, and what to do next. Practical decision guides for analysts, growth teams, and founders. Free. Weekly.
Opens Substack to confirm your subscription · Free · Unsubscribe anytime