Geo-Experimentation
An experimental method that uses geographic regions as test and control units to measure the causal impact of marketing interventions at a market level.
What Is Geo-Experimentation?
Geo-experimentation measures the causal impact of marketing by randomizing treatment at the geographic level — cities, DMAs, states, or countries — rather than at the user level. It solves the problem of measuring channels that can't be randomized individually, such as TV, radio, billboards, or broad-reach digital campaigns that saturate a market.
Also Known As
- Marketing team: "geo lift test," "market-level test"
- Sales team: "regional test"
- Growth team: "geo holdout," "geo experiment"
- Data team: "DMA test," "cluster-randomized trial"
- Finance team: "regional ROI test"
- Product team: "market rollout test"
How It Works
You want to measure whether a $300,000 TV campaign drives incremental sales. You pick 20 matched DMAs and assign 10 to treatment (run TV ads) and 10 to control (no TV ads) for 6 weeks. Before the test, both groups trend at $2M/week in sales. During the test, treatment DMAs generate $2.3M/week while control stays at $2M. The incremental lift is $300K/week × 6 weeks = $1.8M in incremental revenue. ROI = $1.8M / $300K = 6x. Traditional attribution would have missed this entirely — TV has no click.
Best Practices
- Select matched pairs of geographies based on pre-period sales trajectory, not population size alone.
- Use synthetic control methods (GeoLift, CausalImpact) when perfect matches aren't available.
- Run for at least 4-6 weeks to capture full purchase cycles and wash out noise.
- Account for spillover between adjacent markets (media bleed, cross-border shopping).
- Pre-commit to the analysis plan to avoid post-hoc geography selection.
Common Mistakes
- Picking test and control markets after seeing the results (selection bias).
- Running tests too short to capture the buying cycle.
- Ignoring seasonality differences between test and control regions.
Industry Context
Ecommerce and DTC brands use geo-tests heavily for paid social, OOH, and TV — channels where user-level measurement is impossible or unreliable. SaaS and B2B use them less, but land-and-expand companies use geo-tests for regional sales team effectiveness. Lead gen operators use geo-experiments for local service businesses where the service area aligns with DMAs.
The Behavioral Science Connection
Geo-experiments illuminate how environmental context shapes individual decisions. Social proof cascades, availability heuristic, and the mere exposure effect all operate at a market level. When a brand saturates one city with advertising, it doesn't just create individual awareness — it shifts the entire decision context, making the brand feel established and default.
Key Takeaway
When you can't randomize users, randomize regions — geo-experiments are the gold standard for measuring broad-reach marketing causally.