Pillar 05

Test over Debate

"Run the experiment"

Every product idea is a hypothesis. Treat it like one.

When there’s disagreement about what to build, don’t schedule another meeting — design a test. The fastest way to resolve an argument isn’t a better presentation. It’s evidence.

What This Means in Practice

  • Frame features as experiments with clear success criteria
  • Make bets small and reversible
  • Let data settle arguments, not seniority
  • Kill ideas early when evidence says so — no matter who proposed them

Common Traps

  • Debating for weeks what you could test in days
  • Avoiding experiments because you’re afraid of the answer
  • Doubling down on failing ideas to justify sunk costs
  • Designing tests to confirm what you already believe

Remember

“If we have data, let’s look at data. If all we have are opinions, let’s go with mine.” — Jim Barksdale

Or better yet — go get the data.

Put this pillar into practice

The Pragmatic PM Toolkit includes templates built on these principles.