Stupid analytics gets them talking

If data analysis somehow ends up supporting an unwise choice, should we blame the data? Of course not, no more than we should blame a stethoscope for a bad medical diagnosis or fingerprints for a bad courtroom verdict. Common sense says the only ones responsible are the humans involved.

AllAnalytics contributing editor James M. Connolly wrote last week in defense of common sense in a good blog post, “Analytics won’t cure stupidity.”

Let’s admit it, we know the limitations of data analysis. The obvious truth whispers to us in the quiet of our own little minds, and that truth can also find a voice in private business conversations over a beer or lunch.

And that truth of the limitations of data analysis also finds voice in online comments, such as in those responding to Connolly’s post. Such conversations go around and around, often failing to convince anyone. They may have no effect at all on, say, the foolish executive who insists that data must has a predetermined result. But at least some people test arguments, let others know when they’re really off, refute facts, and even make a few people think again. I find what might be thought of as “campfire behavior” — known these days as collaboration and storytelling — exhausting, often annoying, but also crucial. This is where supposedly hard facts, including data analysis, assume the rightful position: subordinate to review by smart people.

Such dangerous ideas! The first comment in the string following the post sounded like a slap at Connolly himself: “This article shows you have the diplomacy and tact in handling issues from the viewpoint of a toastmaster.” The same person commented again a few minutes later with a myopia that’s useful for close examination of data but only obstructs decision making: “You’ve given me a choice: cursing the data or cursing the stupidity. Neither. I look at the facts and draw a conclusion very carefully. I am mathematically-oriented.”

“Toastmaster” Connolly replied, “No, Judith, you don’t have to choose between data and stupidity. Just be aware that even the best data project could place the results in the hands of the very fallible human…” She replied, seeming to have missed his point again.

Others joined in. One told a story about presenting analysis to executives only to discover that they didn’t care about the analysis, they only wanted a certain conclusion. He wrote, “The endpoint was already decided.”

Another asked what if the analysts are the “stupid ones”? Still another told about the eroded trust that results from predetermined results. And another commenter wrote, “I’ve heard that technology will never truly change the world because the problem isn’t technology, it’s humans.  I guess the same could be said of analytics.”

That’s right, the problem — and the promise — is with humans.

The best remedy for stupidity is a traditional one: conversation. It’s not perfect, and often it takes a long succession of campfires ignited and exhausted before sense emerges. And sometimes the result is still stupid. But it’s always smarter than leaving everything to the data, no matter how “careful” any data analysis may have been.

Leave a reply

Other recent posts

Qlik finally set to leapfrog Tableau?

Who’s your rival? I carelessly asked a Qlik person at the company’s annual analyst reception Monday night in Miami if she hadn’t once worked for Tableau. Her revulsion was immediate. “No! Never!,” she said. We smiled. There was so much more to talk about. For one thing, how will private equity change things? Qlik wasn’t… Continue Reading

Five Tips for Better Data Stories

Originally published on September 22, 2015 in BI This Week, a TDWI publication. A “data story” sounds like such a great idea. You just mix data with storytelling and you’re done — except that most data storytellers get one thing wrong: they drown out the story with data. Such storytellers, I believe, assume that audiences… Continue Reading

Bohemian Grove a la BI

The Bohemian Grove of the BI industry convenes for the fifteenth time in just three weeks. Naturally, you ask the obvious question: Are you serious? The Grove? A summit? The answer begins with a fond recollection of the Grove. If you’ve never attended the Bohemian Grove yourself — I haven’t, though I live in the… Continue Reading

Favorite Star Trek, a data story

This story shows how elemental data stories really are. Humans come ready to tell and hear them, requiring no plug-ins at all. This young person can do a good job of it. There was a question, followed by data, then questions and answers, and and finally a conclusion. It’s all there. It’s elementary. Sure, this… Continue Reading