“Good enough” data analysis will lead to good data analysis

Someone on Quora asks, “What are the most promising disruptive innovations for the next decade (2011-2020)?”

The always incisive Venkatesh Rao offered a long list. At least one of his predictions brings to mind the decision support industry’s many do-it-yourself tools.

Deprofessionalization/democratization: if you thought blogging taking down professional writing, and amateur photography threatening professional photography were big, you ain’t seen nothing yet. Tons of problems that previously required professional expertise to solve can now be re-engineered so that amateurs can solve them. Movies and education are next.

Look around. If the tools don’t exist, but the high-margin professionals and eager amateurs do, try and invent them.  A big opportunity here is for amateur animated video shows. There are some primitive things that get animated characters speak out scripts, but we’ve barely scratched the surface.

Note the absence of data analysis. He could have listed it along with movies and education. But he didn’t, most likely because he knows too much about it to accept “good enough.”

People tend to go along with the good-enough except in their own field. There they see exactly why “good enough” just isn’t. Professional writers and photographers still scoff today at amateurs’ work even 20 years into that takedown.

When you need something done well, you hire a pro. But for many jobs, you can get by on “good enough” — until you’re skilled enough to know what you’re missing or curious enough to want something better.

That path played a big part in the California wine industry’s recent history. Back in the early ’80s, I talked to the finance officer of one of the many new craft brewers in California. He had seen how mass tastes work a decade before with the rise of a bad jug wine, Italian Swiss Colony. (“Made by that little old winemaker, me.”)

Sure, the stuff was awful by today’s standards. But the marketing got Americans drinking wine. Before long, many of them wanted to know how the good stuff tasted. So throughout the ’70s and even today, small wineries thrive thanks to that new thirst.

So it will be with data analysis, not to mention movies and education.

2 Responses to “Good enough” data analysis will lead to good data analysis

Leave a reply

Other recent posts

End of one-size-fits-all data stories

This appeared originally on the TDWI site in September behind a paywall. It’s still there, but today they’ve had the 90 days of exclusive use that I agreed to. Survey after survey reveals that about 80 percent of business users don’t use data analysis—despite all the marketing and “easy to use” tools. As if in… Continue Reading

Qlik finally set to leapfrog Tableau?

Who’s your rival? I carelessly asked a Qlik person at the company’s annual analyst reception Monday night in Miami if she hadn’t once worked for Tableau. Her revulsion was immediate. “No! Never!,” she said. We smiled. There was so much more to talk about. For one thing, how will private equity change things? Qlik wasn’t… Continue Reading

Five Tips for Better Data Stories

Originally published on September 22, 2015 in BI This Week, a TDWI publication. A “data story” sounds like such a great idea. You just mix data with storytelling and you’re done — except that most data storytellers get one thing wrong: they drown out the story with data. Such storytellers, I believe, assume that audiences… Continue Reading

Bohemian Grove a la BI

The Bohemian Grove of the BI industry convenes for the fifteenth time in just three weeks. Naturally, you ask the obvious question: Are you serious? The Grove? A summit? The answer begins with a fond recollection of the Grove. If you’ve never attended the Bohemian Grove yourself — I haven’t, though I live in the… Continue Reading