To date, Big Storage has been locked out of Big Data. It’s been all about
direct attached storage for several reasons. First, Advanced SQL players have
typically optimized architectures from data structure (using columnar),
unique compression algorithms, and liberal usage of caching to juice response
over hundreds of terabytes. For the NoSQL side, it’s been about cheap,
cheap, cheap along the Internet data center model: have lots of commodity
stuff and scale it out. Hadoop was engineered exactly for such an
architecture; rather than speed, it was optimized for sheer linear scale.
Over the past year, most of the major platform players have planted their
table stakes with Hadoop. Not surprisingly, IT household names are seeking to
somehow tame Hadoop and make it safe for the enterprise.
Up ' til now, anybody with armies of the best software engineers that
Internet fir... (more)
As we’ve noted previously, the measure of success of an open source stack
is the degree to which the target remains intact. That either comes as part
of a captive open source project, where a vendor unilaterally open sources
their code (typically hosting the project) to promote adoption, or a
community model where a neutral industry body hosts the project and gains
support from a diverse cross section of vendors and advanced developers. In
that case, the goal is getting the formal standard to also become the de
The most successful open source projects are those t... (more)
At this point, probably at least 90 percent or more of analytic systems/data
warehouses are easily contained within the SQL-based technologies that are
commercially available today. We’ll take that argument a step further: Most
enterprise data warehouses are less than 5 terabytes. So why then all the
excitement about big data, and why are acquisitions in this field becoming
almost a biweekly thing?
To refresh the memory, barely a couple weeks back, HP announced its intention
to buy Vertica. And this morning came the news that Teradata is buying the
other 89 percent of Aster Data ... (more)
Is it more than coincidence that IT acquisitions tend to come in waves? Just
weeks after IBM's announcement to snap up Lombardi, Progress Software today
responds with an agreement to put Savvion out of its misery? In such a small
space that is undergoing active consolidation, it is hard not to know who's
Nonetheless, Progress's acquisition confirms that Business Process Management
(BPM)'s pure play days are numbered, if you expect executable BPM.
The traditional appeal of BPM was that it was a business stakeholder-friendly
approach to developing solutions that didn't rely... (more)
It’s no secret that rocket .. err … data scientists are in short supply.
The explosion of data and the corresponding explosion of tools, and the
knock-on impacts of Moore’s and Metcalfe’s laws, is that there is more
data, more connections, and more technology to process it than ever. At last
year’s Hadoop World, there was a feeding frenzy for data scientists, which
only barely dwarfed demand for the more technically oriented data architects.
In English, that means:
Potential MacArthur Grant recipients who have a passion and insight for data,
the mathematical and statistical prow... (more)