How NRG Scaled to 100+ Experiments with $30M+ in Internal Program Reporting
How NRG scaled from roughly 20 to 100+ annual tests across five brands, with $30M+ in internal program reporting and explicit evidence limits.
Read Article→
Free Learning · Better Decisions Make Growth Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical guides for analysts, growth teams, and founders.
Optimizely Visual Editor Not Working? Here's How to Fix It
Complete troubleshooting guide for the Optimizely visual editor not loading or working.
Read Article→
Optimizely Snippet Performance: How Much Does It Slow Down Your Site?
The honest numbers on Optimizely's page speed impact — async vs. synchronous snippet, anti-flicker costs, Core Web Vitals effects, and how to measure and…
Read Article→
Why Your Optimizely Experiment Isn't Showing Visitors (Troubleshooting Guide)
The complete diagnostic guide for Optimizely experiments showing zero or very low visitor counts.
Read Article→
How to Fix the Optimizely Flicker Problem (FOOC)
The complete guide to diagnosing and fixing Optimizely flicker (Flash of Original Content).
Read Article→
Optimizely Alternatives: 6 Platforms Worth Considering in 2026
Honest, specific comparison of 6 Optimizely alternatives — VWO, AB Tasty, Statsig, Convert, LaunchDarkly, and GrowthBook — with a decision framework to help…
Read Article→
10 A/B Tests Every CRO Team Should Run (With Benchmarks)
Not a list of random test ideas. These are 10 high-ROI tests with hypothesis templates, realistic lift benchmarks, and what to test next after a win or a…
Read Article→
How to Write A/B Test Hypotheses That Actually Lead to Insights
"Let's test a bigger button" is not a hypothesis. Here's the full hypothesis template, 5 bad-to-good rewrites, and how a good hypothesis turns a losing test…
Read Article→
What Is Statistical Significance in A/B Testing? (Plain-English Explanation)
Most definitions of statistical significance are wrong — or at least misleading.
Read Article→
How Long Should You Run an A/B Test? (The Definitive Answer)
There's no single number. But there is a rigorous framework. Here's how to calculate exactly how long your A/B test needs to run — and why stopping early is…
Read Article→
How to Build an A/B Testing Roadmap (That Isn't Just a Feature Wishlist)
Most A/B testing roadmaps fail because they list tests, not hypotheses.
Read Article→
When to Stop an A/B Test: A Framework That Protects Your Data
Most teams stop A/B tests for the wrong reasons. This framework gives you four conditions to verify before calling a test — and explains the peeking…
Read Article→
Minimum Detectable Effect (MDE): How to Set It in A/B Tests
What minimum detectable effect (MDE) means, the formula behind it, and how to choose one so your A/B tests aren't underpowered or endless.
Read Article→
Bayesian vs Frequentist A/B Testing: A Practitioner's Honest Guide
A practical comparison of Bayesian and frequentist A/B testing from a CRO practitioner who's run 100+ experiments.
Read Article→
Getting Started With Optimizely Web Experimentation: A No-Fluff Setup Guide
The correct Optimizely setup sequence — snippet installation, A/A testing, custom events, naming conventions, and the 5 mistakes that create months of bad data.
Read Article→
The Optimizely Practitioner Toolkit: Start Here
The front door to the Optimizely Practitioner Toolkit. Find the right learning path based on where you are, avoid the 5 most common mistakes, and access all…
Read Article→
How Optimizely Counts Conversions (And Why It Changes Your Results)
Visitor-based vs session-based conversion counting, the exact math showing how it changes your reported rate, unique vs all conversions, how to audit your…
Read Article→
Ratio Metrics, Revenue Metrics, and Conversion Metrics in Optimizely: When to Use Each
The three Optimizely metric types explained for practitioners — when revenue per visitor beats revenue per purchase, the variance problem with revenue…
Read Article→
Choosing the Right Primary Metric for Your A/B Test
Why you can only have one primary metric, how to choose it correctly, why revenue per visitor usually beats CVR alone, and how metric selection affects test…
Read Article→
URL Targeting vs Audience Targeting in Optimizely: What's the Difference?
The exact technical difference between URL targeting and audience targeting in Optimizely, when to use each, wildcard patterns, regex examples, and the most…
Read Article→
Audience Conditions in Optimizely: A Practical Guide to Targeting
A practitioner-level guide to Optimizely audience conditions — AND/OR logic, cookie targeting, dynamic evaluation timing traps, and why your audience is…
Read Article→
How to Build an Experimentation Roadmap That Actually Gets Used
Most testing roadmaps are just feature wishlists. Here's how to build a real experimentation roadmap—with prioritization frameworks, sequencing logic, and…
Read Article→
Metrics by Revenue Model: What to Measure Based on Your Business Type
"Conversion rate" means completely different things for an ecommerce site vs. SaaS vs. media company.
Read Article→
How to Share A/B Test Results With Stakeholders (Who Don't Care About P-Values)
Your CEO doesn't care about statistical significance. Here's the one-page results template, the revenue translation formula, and how to handle every awkward…
Read Article→
Better Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical decision guides for analysts, growth teams, and founders. Free. Weekly.
Opens Substack to confirm your subscription · Free · Unsubscribe anytime