Fujitsu Develops Big Data Solution but Faces Industry-Wide Skills Gap
The growth of powerful computing solutions over the past few years has given businesses of all sizes the ability to capture massive amounts of information. Turning that information into actionable intelligence, a process called "big data," may seem simple on its face but is actually remarkably complicated. The process not only requires specific systems and tools, but also employees who know how to get the most out of those systems.
The problem with massive amounts of data, consisting of either hundreds of terabytes or several petabytes, is not just in the difficulty in moving through that much information but also in dealing with the fact that most of the data is completely unstructured. To help businesses with this problem, Fujitsu recently announced the release of a suite of software tools designed to handle massive amounts of information.
As noted in this InfoWorld article, the new software will include the Interstage Big Data Parallel Processing Server, which will be able to build a database across a network of servers, expanding on the technology in the popular Apache Hadoop platform. Fujitsu will also release the Complex Event Processing Server, which attempts to quickly spot trends in massive data sets. The company also plans to release hardware for the new packages sometime in the next year.
The announcement shows that while some companies may be struggling under the weight of all their collected information, there are solutions on the horizon. As more of these solutions come onto the market, expect prices to fall and the majority of midsize businesses to be able to take advantage of these solutions.
Big Data Skills Gap
Of course, these solutions are only helpful if there are IT professionals able to run them, a fact that is currently causing issues in the IT sphere. According to this IT World article, there is a significant need for people qualified in these emerging data solutions. A solution like Hadoop certainly has the ability to harness large amounts of data, but only in the hands of someone with the proper developer skills.
The problem can be combatted on two fronts. First, big data solution developers, like IBM, EMC, and Teradata, can develop smarter tools to lower the bar when it comes to the required experience on the user's end. This is, in part, what Fujitsu hopes to do with its new products. Second, businesses can express their need in the hopes that specialized training solutions become available for their employees. With the explosion of data over the past few years, this is really an eventuality, but the sooner IT managers can get their existing personnel trained, the better off the industry, as a whole, will be.
IDC is predicting an annual growth rate of almost 40 percent in the data hardware, software, and services sector, and that doesn't even include the growth in open source data solutions. The need for data solutions and skills has never been higher, and those companies that acquire or develop these solutions or skills are poised to quickly reap the benefits.
This post was written as part of the IBM for Midsize Business program, which provides midsize businesses with the tools, expertise and solutions they need to become engines of a smarter planet. Like us on Facebook. Follow us on Twitter.