The Highest Paid Person's Opinion
In most organizations, decisions follow a predictable hierarchy. When opinions conflict, the senior person wins. This is the HiPPO effect: the Highest Paid Person's Opinion becomes the default decision, regardless of what evidence suggests.
The HiPPO dynamic is not inherently bad. Senior leaders have accumulated experience, pattern recognition, and contextual knowledge that junior team members lack. The problem arises when opinion consistently overrides evidence, even in situations where evidence is available, relevant, and clear.
Why the HiPPO Effect Persists
The HiPPO effect is not a bug in organizational design. It is a feature that serves several functions:
Speed
Gathering evidence takes time. Waiting for experiment results delays decisions. In fast-moving markets, the speed advantage of opinion-based decisions is real and sometimes valuable.
Accountability
Someone has to own the decision. Opinion-based decision making has clear accountability: the person who made the call. Data-driven decision making can diffuse accountability in ways that make organizations uncomfortable.
Simplicity
Opinions are easy to act on. Data requires interpretation, context, and judgment about statistical validity. For many decisions, the cognitive cost of rigorous data analysis exceeds the benefit.
Power Preservation
Let us be direct. The HiPPO effect preserves existing power structures. If decisions are made by data, senior leaders lose some of their authority. Not everyone wants that.
Understanding these drivers is essential because you cannot fight a dynamic you do not understand.
The Real Spectrum
The debate between HiPPO and data is usually framed as a binary. It is not. Decisions exist on a spectrum:
- Pure opinion: No data consulted. Decision based entirely on judgment and experience.
- Opinion-informed by data: Data is gathered but serves as input to a judgment call. The decision maker retains full discretion.
- Data-informed by opinion: Data drives the decision, but qualitative judgment handles edge cases and unmeasured factors.
- Pure data: The data decides. Human judgment is limited to ensuring the methodology is sound.
Most organizations should not be at either extreme. The goal is to match the decision type to the appropriate point on the spectrum.
When the HiPPO Is Right
Before building your case against opinion-based decisions, acknowledge where expert judgment genuinely outperforms data:
- Novel situations where historical data does not exist or is not relevant
- Brand and values decisions where the right answer is not about optimization but about identity
- Speed-critical decisions where the cost of waiting for data exceeds the cost of being wrong
- Complex system decisions where experiments can only measure first-order effects but the important consequences are second or third order
- Small-stakes decisions where the investment in gathering data is not justified by the decision's impact
Respecting these boundaries makes your argument for data-driven decisions more credible, not less.
When the HiPPO Is Dangerous
Opinion-based decisions become dangerous in predictable situations:
- High-stakes decisions where the cost of being wrong is large and the cost of gathering evidence is small relative to the stakes
- Repeated decisions where the organization makes the same type of decision frequently and would benefit from systematic learning
- Ego-invested decisions where the decision maker's identity is tied to a particular outcome
- Consensus decisions where a senior person's opinion drowns out dissenting evidence from people closer to the customer
Your experimentation program should focus on these situations. This is where the highest value lies and where the case for data is strongest.
Practical Navigation Strategies
Make It Easy to Be Data-Driven
The HiPPO wins partly because opinion is frictionless. Data requires effort. Reduce that friction:
- Provide real-time dashboards that make current performance visible
- Create templates that make experiment proposals simple
- Deliver results in formats that require minimal interpretation
- Automate as much of the testing process as possible
When using data is as easy as having an opinion, the HiPPO advantage shrinks.
Create Decision Categories
Work with leadership to categorize decisions:
- Category A: High impact, reversible, measurable. These must go through experimentation.
- Category B: Medium impact, partially measurable. These should go through experimentation when feasible.
- Category C: Low impact, fast-moving, judgment-appropriate. These use expert opinion.
This framework gives leadership explicit permission to use judgment for appropriate decisions while establishing clear expectations for high-stakes ones.
Use the Pre-Mortem Technique
Before a HiPPO-driven decision is finalized, run a pre-mortem. Ask the group: imagine this decision fails spectacularly. What went wrong?
Pre-mortems are powerful because they give people permission to voice concerns about the HiPPO's preferred direction without directly challenging the person. The concerns that surface often point to factors that could be tested experimentally.
Propose Bets
When a leader advocates for a direction that contradicts your data instincts, propose a friendly bet. Frame the experiment as settling the question. Leaders who are confident in their judgment often agree, and the experiment runs with their engagement rather than their resistance.
Build a Library of HiPPO Failures
Keep a running record of decisions where opinion overrode data and the outcome was negative. This is not a weapon. It is organizational learning. Present it periodically as part of decision quality reviews.
Also keep a record of where the HiPPO was right and data was misleading. Intellectual honesty builds more credibility than cherry-picked evidence against opinion-based decisions.
Changing the Culture
The HiPPO effect is a cultural phenomenon, and cultural change happens slowly. Focus on:
Language
Replace "I think" with "I hypothesize." Replace "I know" with "evidence suggests." Replace "let us build it" with "let us test it." Language shapes thinking, and changing the words people use in meetings gradually shifts the decision-making norms.
Incentives
Reward people for being right, not for being confident. Celebrate decisions that were changed based on data. Recognize leaders who say, "I was wrong, and the data showed me."
Norms
Establish meeting norms where opinions must be accompanied by evidence or explicitly flagged as assumptions. This does not eliminate opinion. It makes the role of opinion visible and explicit.
Stories
Collect and share stories about times experimentation prevented expensive mistakes or revealed surprising opportunities. Stories are more persuasive than data when it comes to cultural change. Ironic, but true.
The Partnership Model
The most effective experimentation programs do not position themselves against the HiPPO. They position themselves as a tool that makes the HiPPO more effective.
The message is not: your opinion is wrong, and we have data to prove it. The message is: your judgment is valuable, and experimentation helps you deploy it more effectively by revealing which of your instincts to trust.
This framing transforms experimentation from a threat to an amplifier. It gives senior leaders a reason to embrace data without giving up their role as decision makers.
Frequently Asked Questions
How do I challenge a HiPPO without damaging my career?
Frame challenges as questions, not arguments. Instead of saying the data disagrees, ask what would change their mind. Position yourself as seeking understanding, not as challenging authority. The question approach is safer and often more effective.
What if the HiPPO is actually right most of the time?
Track it. If the HiPPO's judgment is genuinely accurate, that is valuable information. It may mean your experimentation program should focus on areas where judgment is less reliable rather than trying to override good instincts.
Can experimentation coexist with strong leadership?
Absolutely. The best experimentation programs amplify strong leadership rather than replacing it. Data helps leaders focus their judgment on the decisions that truly require it, while systematically handling the decisions that can be resolved empirically.
How long does it take to shift from a HiPPO culture to a data-driven culture?
Expect two to three years of sustained effort. Cultural change does not happen in quarters. It happens through consistent demonstration of value, gradual norm-shifting, and strategic patience.