Is the data lake following the typical path for new technology? Merv Adrian, research VP, data management and integration and Gartner was talking about data lakes and big data projects at the just-concluded Pacific Northwest BI and Analytics Summit. Josh Good, senior director of product marketing at Qlik asked the question.
That’s a terrific question. We’re talking about a phenomenon of some recency which is the notion of the new platform sell. [It’s] not a new application, not a new function, but a new platform designed to replace existing ones or supplement them (usually the first until they figure out that’s not practical). And that, I think, is the larger market failure … or the blunting of the thrust that there’s this new opportunity to build new platforms.
I’m relatively convinced that people coming into the market now are not thinking about the replacement of the end to end. They are looking for parts. If they’ve gotten at all sophisticated or knowledgable about how to achieve the outcome that they presumably have defined, then they have put together in their head at least some sort of chart they can draw on the wall, which is a bunch of boxes that connect to one another with flows, and they’re identifying the APIs among them.
That’s becoming an issue especially as we move to the cloud and people start talking about services-based architectures and are thinking about the way they want to get to where they want to go is a composition exercise, not an architecture one.