Big Data, big hype, big danger

by Ted Cuzzillo on April 12, 2013

A remarkable thing happened in Big Data last week. One of Big Data’s best friends poked fun at one of its icons: the Three V’s.

The well-networked and alert observer Shawn Rogers, vice president of research at Enterprise Management Associates, tweeted his eight V’s: “…Vast, Volumes of Vigorously, Verified, Vexingly Variable Verbose yet Valuable Visualized high Velocity Data.”

He was quick to explain to me that this is no comment on Gartner analyst Doug Laney’s three-V definition. Shawn’s just tired of people getting stuck on V’s.

How strange to be stuck on a definition, but we get stuck all the time trying to define Big Data. Other terms are easier. We’ve always known what visualization is. We seem to agree on “self service BI.” We also know what relational databases are, what ETL is, and all kinds of other established technology. We don’t agree on “business intelligence” or “decision support,” but somehow we don’t dwell on it. We don’t even quibble too heartily with “easy to use,” even though I could argue that we should.

So what is it about Big Data? Is it so much bigger than everything else? I don’t think so. We quibble endlessly and tiresomely because Big Data’s benefits live mostly in the imagination. There are just too many versions of the truth.

It’s as if an emperor went to his royal tailor, got measured up, and — so flattered, he was, and so enamored of the new material his tailor described — he left wearing just the measuring tape and imagined the rest. Outside, his loyal crowds cheered. Soon everyone was certain the emperor really had new robes.

The patient and imaginative among us appreciate the potential. Technology has given us greater ability to manage all our clicks, tweets, and machine effluent. Meanwhile, business users are more interested than ever in what all the new data may tell them. Skeptic that I am, even I see it. I like to make an analogy with television’s emergence and its finer and finer resolution and dimensions.

That idea comes from one of the few presentations I’ve seen at which anyone made real sense of Big Data. Last summer at Scott Humphrey’s Pacific Northwest BI Summit, Harriet Fryman of IBM and Colin White of BI Research described the work in progress with concrete examples. (I wrote about it here on Datadoodle and later for Information Management, here.)

I can wait years for that to develop. It’s the hype and the preoccupation that makes me impatient. Blogs and articles yammer on with the benefits of “big data” when in fact they’re repeating promises made years ago about the benefits of small data and small analytics. This is old decision support super-sized and warmed over, the “new and improved” that won’t satisfy any better than the original but which costs much, much more.

This is where I join visualization guru Stephen Few. Last summer in his essay “Big Data, Big Ruse,” he wrote, “If you’re like me, the mere mention of Big Data now turns your stomach,” and “Big Data is the technological expression of gluttony.” He quoted a book that would be more popular in the industry if concern for analytics and insight were more widespread:

As Richards J. Heuer, Jr. argued in Psychology of Intelligence Analysis, the primary failures of analysis are less due to insufficient data than to flawed thinking. To succeed analytically, we must invest a great deal more of our resources in training people to think effectively, and we must equip them with tools that support that effort.

Similar though less visceral thoughts come from consultant and industry analyst Mark Madsen, one of the most interesting minds in the industry. Toward the end of an early 2011 presentation at Strata Conference titled “The Mythology of Big Data,” he gave the decision support industry a tip:

We succeed only as well as the users of the tools that we provide succeed with our aid. Since most of us are working for or supporting organizations or corporate decision making, that’s the stuff that needs to be supported, and it needs to be supported through proper tools. It’s not just about big and it’s not just about data.

I expect Steve and Mark to watch the emperor away from the crowds. But frustration seems to have gathered in the good seats, too. Gartner analyst Merv Adrian tweeted last weekend, “Enterprises don’t want to buy ‘big data,’ [they] want solutions. If they don’t have [one] or a way to find [one] …, ‘big data’ is a waste of time.”

Even a representative of a vendor that profits well on Big Data technology warns of Big Data fatigue. He says, “There’s a big ‘so what?’ building” among business people. The company continues to push Hadoop, though. He says, “We don’t want to seem like old news.”

One marketing guy who’s beating the “pretty big data” trail of terabytes, not petabytes, sees a “chasm” building from marketing that creates a “special conversation.” It splits technical teams and makes us obsess over “the elite, the power user, the data priest.” SiSense vice president of marketing Bruno Aziza says, “It drives me nuts.”

I admit that I may not even pay enough attention anymore. I may have begun to do what the venture capitalist and influential guy Paul Kedrosky does now: Filter out Big Data. “Soothing,” he tweeted early this year. “Recommended.” Big Data Hype gets shut out, and so does the industry with it. There we have Big Danger.

{ 2 comments }

Collaboration for the collaboratively resistant

by Ted Cuzzillo on April 2, 2013

“Unless you’re a sociopath,” the slogan goes, “you’re going to collaborate.” It works. In one breath, “sociopath” gets our attention while it identifies and strokes us. Then we’re left helpless to disagree with the last part, “you’re going to collaborate.”

Of course we will! Collaboration works for us normal people. QlikTech vice president of product management Donald Farmer’s slogan is so good, in fact, that we accept it without thought. Good thing, too, because collaboration is a wave the decision support industry can’t afford to miss.

The trouble is that collaboration is a tricky one. What makes it especially hard are all the people in business who are technically sub-sociopathic but who are in fact collaboratively disabled. The sociopath wannabes, pretenders, bluffs, intellectual exhibitionists, and other varieties could make the industry long for the good old days when Big Data seemed big.

[click to continue…]

{ 1 comment }

BI’s “promised land”: bigger than tech

February 14, 2013

At first glance, this pair of tweets last week sounds like a version of BI’s traditional campfire song: I’ve seen the promised (BI) land, and we are there: databases that fly and process any data; BI tools that are easy to use and fast. Wow! I’d retire but mainstream firms will take 10 years to [...]

Read the full article →

The wisdom of one in a circled R

January 24, 2013

What does Howard Dresner’s recent trademark registration mean? He says that registering “Wisdom of Crowds” is “all about protecting intellectual property.” Well, obviously. It’s obviously more than that, too. This is the guy who’s famed for naming and helping define the business intelligence industry. When he shows up at TDWI and other hardcore BI events, [...]

Read the full article →

Self service BI, dead or alive?

September 10, 2012

Yellowfin CEO Glen Rabie declared self service BI “dead,” but he actually had some other death in mind that had bigger implications for the business intelligence industry.

Read the full article →

Data surfing with big data

August 16, 2012

The usual big-data story leaves out crucial bits. We hear about the “what” — big, huge data of all kinds. We hear about the “when” — now and coming soon. We hear about the “how” — Hadoop with helpers. But we almost never hear about the “who” and the “why.” Who’s bothering to analyze all [...]

Read the full article →

What goes on at the Weasku Inn

May 25, 2012

If you’re out for networking in the BI industry and keeping score in sheer numbers, you still attend TDWI or Strata. But to go deep with smaller numbers, you try to get into the tiny Pacific Northwest BI Summit, held every July in remote southern Oregon. There’s room for about two dozen people, including press. [...]

Read the full article →

Did you consider adopting QlikView?

May 24, 2012

No matter what tool you use now — Tableau, Spotfire, Excel, tarot cards, or “gut” — I want to hear what you decided when you looked at QlikView. Please go to this form now and tell me what you can. I’m helping QlikTech understand how people decide whether to adopt QlikView or not. If you [...]

Read the full article →

The future of BI in two words

April 24, 2012

What’s the future of BI? Last fall, one sharp source of mine answered, “Two words: Tableau and QlikView. You didn’t hear it here.” Those are startling words coming from that source, a well-regarded BI consultant known for big-name clients and their big deployments. At about the same time, a column of mine appeared in Information [...]

Read the full article →

Still a “tool” by any other name

April 20, 2012

A marketing manager I know stopped me in mid sentence. He didn’t want me to call his business intelligence product a “tool.” Why? “It sounds small,” he said. But it is small, I pointed out. It’s smaller than many others in its space. It’s downloaded in under a minute and unpacks itself on a desktop [...]

Read the full article →