Are You Comfortable with a 5% Chance of Being Wrong?

In the world of Continuous Improvement, we lean heavily on data. Statistical tools give us confidence in our decisions, helping us cut through noise and separate real signals from random variation. But here’s the catch: while we might be comfortable with concepts like “alpha risk” and “confidence intervals,” our stakeholders might not be.

Take the cartoon above. William Tell is about to shoot an apple off his son’s head, bow in hand, and his son asks the all-too-reasonable question:

“So let me get this straight, Dad. You’re perfectly fine with a .05 alpha risk?”

It’s funny because it highlights something we often overlook—statistics may assure us that we have a 95% chance of being right, but to the person on the receiving end of the risk, even 5% feels huge.

That’s where communication comes in.

As CI leaders, it’s not enough for us to know the data. We need to translate it in a way that makes sense to the people impacted by it. That might mean swapping technical terms for everyday language, painting a picture of what the numbers mean in practice, or even acknowledging the emotional side of risk.

Because at the end of the day, stakeholders aren’t looking for statistical significance—they’re looking for confidence in you.

So the next time you’re sharing results, ask yourself:

• Am I explaining this in a way that builds trust?

• Am I helping others feel safe with the decision?

• Or am I standing there with a bow and arrow, expecting them to be okay with a 5% chance of getting hurt?

Data is powerful, but it only creates change when people believe in it. And people believe in it when they trust the person presenting it.

Let me know how you handle communicating stats, and more specifically the impact of possibly being wrong?