Revenue-First Experimentation

How Optimizely Counts Conversions (And Why It Changes Your Results)

Visitor-based vs session-based conversion counting, the exact math showing how it changes your reported rate, unique vs all conversions, how to audit your…

Ratio Metrics, Revenue Metrics, and Conversion Metrics in Optimizely: When to Use Each

The three Optimizely metric types explained for practitioners — when revenue per visitor beats revenue per purchase, the variance problem with revenue…

Choosing the Right Primary Metric for Your A/B Test

Why you can only have one primary metric, how to choose it correctly, why revenue per visitor usually beats CVR alone, and how metric selection affects test…

URL Targeting vs Audience Targeting in Optimizely: What's the Difference?

The exact technical difference between URL targeting and audience targeting in Optimizely, when to use each, wildcard patterns, regex examples, and the most…

Audience Conditions in Optimizely: A Practical Guide to Targeting

A practitioner-level guide to Optimizely audience conditions — AND/OR logic, cookie targeting, dynamic evaluation timing traps, and why your audience is…

ab-testing Mar 31, 2026 12 min read

How to Build an Experimentation Roadmap That Actually Gets Used

Most testing roadmaps are just feature wishlists. Here's how to build a real experimentation roadmap—with prioritization frameworks, sequencing logic, and…

analytics Mar 31, 2026 11 min read

Metrics by Revenue Model: What to Measure Based on Your Business Type

"Conversion rate" means completely different things for an ecommerce site vs. SaaS vs. media company.

communication Mar 31, 2026 13 min read

How to Share A/B Test Results With Stakeholders (Who Don't Care About P-Values)

Your CEO doesn't care about statistical significance. Here's the one-page results template, the revenue translation formula, and how to handle every awkward…

ab-testing Mar 31, 2026 12 min read

How to Write A/B Test Hypotheses That Don't Suck

"Let's test a bigger CTA" is not a hypothesis. Here's the exact structure for writing A/B test hypotheses that produce useful results whether they win or…

ab-testing Mar 31, 2026 11 min read

Why Optimizely Data Doesn't Match Google Analytics (And How to Fix It)

Optimizely and GA4 will never show identical numbers — and that's expected.

When to Stop an A/B Test (And Why 95% Confidence Isn't Enough)

Stopping rules for A/B tests: what 95% confidence does and doesn't guarantee, the peeking trap, and how to call a test without wrecking your data.

Segmenting A/B Test Results in Optimizely: Where the Real Insights Hide

The top-line result is often a lie. This guide shows you how to segment Optimizely results correctly, which segments actually matter, and how to avoid the…

How to Read Your Optimizely Results Page (A Complete Walkthrough)

A practitioner's guide to every element on the Optimizely results page — what it means, what to check first, and how to avoid the most common misreads that…

aa-test Mar 31, 2026 10 min read

How to Run an A/A Test in Optimizely (And What It Actually Tells You)

Most teams skip A/A tests and only realize the mistake after shipping a 'winner' that quietly reverses.

ab-testing Mar 31, 2026 14 min read

10 High-Impact A/B Tests You Can Launch in Optimizely This Week

Not all A/B tests are equal. Here are 10 experiments with tight behavioral hypotheses, realistic lift expectations, and the exact failure modes to watch out…

A/B vs Multivariate vs Multi-Page Testing: Which Should You Run?

The wrong test type is one of the most common ways CRO programs waste months.

Why You Can Never Change a Running Experiment (And What To Do Instead)

Someone changed your live A/B test. Maybe it was you. Here's exactly what that broke, why the data is compromised, and the step-by-step rescue workflow to…

ab-testing Mar 31, 2026 8 min read

How Long Should You Run an A/B Test? (The Real Answer)

Seven years running 100+ experiments taught me that test duration is the most violated rule in CRO.

ab-testing Mar 31, 2026 13 min read

Minimum Detectable Effect (MDE): The Most Important Number You're Not Setting Correctly

MDE isn't a calculator input — it's the foundation of your entire experiment design.

Bayesian vs Frequentist Testing in Optimizely: Which Should You Choose?

Optimizely now offers three statistical engines: Sequential (Stats Engine), Frequentist Fixed Horizon, and Bayesian.

ab-testing Mar 31, 2026 11 min read

Statistical Significance in Optimizely: What It Really Means

How Optimizely calculates statistical significance, what 95% actually tells you, and the common misreadings that cost teams real money.

ab-testing Mar 31, 2026 12 min read

Why Your Optimizely Results Keep Changing (And When to Worry)

Tuesday your experiment shows 94% confidence. Friday it's 71%. Nothing changed — so what's happening?

False Discovery Rate in Optimizely: Why Running Many Tests Simultaneously Is Riskier Than You Think

Running 20 tests at 95% confidence means you expect at least one false positive by chance.

ab-testing Mar 31, 2026 11 min read

Why Your Optimizely Test Isn't Statistically Significant

Five reasons Optimizely experiments stall below statistical significance — sample size, MDE, traffic allocation — and the fix for each one.