The Siren Song of Certainty

Statistician William Briggs ran a great post today under the headline “Uncertainty Is an Impossible Sell” (h/t Danilo Freire on Facebook). Read the whole thing, but here’s the money quote:

If you want to set up business as a data scientist (the newfangled term by which statisticians are beginning to call themselves), the lesson is this: promise the moon and charge like you’re actually going there. Failure is rarely punished and never remembered.

Sad but true. Sad because the siren song of certainty tempts us into wasteful spending and poorly informed decision-making and makes it tougher for honest brokers to compete in the marketplace of paid work and ideas.

Here’s Daniel Kahneman on the latter point in Thinking, Fast and Slow (pp. 262–263):

Optimism is highly valued, socially and in the market; people and firms reward the providers of dangerously misleading information more than they reward truth tellers…

Experts who acknowledge the full extent of their ignorance may expect to be replaced by more confident competitors, who are better able to gain the trust of clients. An unbiased appreciation of uncertainty is a cornerstone of rationality—but it is not what people and organizations want. Extreme uncertainty is paralyzing under dangerous circumstances, and the admission that one is merely guessing is especially unacceptable when the stakes are high. Acting on pretended knowledge is often the preferred solution.

Remember, the con in con artist is short for confidence. The more excited or flattered or assured a forecaster or other expert makes you feel, the more skeptical you should probably be.

Leave a comment

1 Comment

  1. “The con is short for confidence”. I like that.. good read.

    Reply

Leave a Comment

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: