Was Spock the first Data Analyst?

The last couple of years a discussion around the information society has started. Since more people enter data around their lives as well our planet, it was obvious that business start to leverage this trend and added more data; like Google scanned the library of Congress, mapped the planet including the oceans. Nowadays this is topped. Data combination and new streams of information are provided, some free some for purchase.

Now in the Star Trek series the chief scientist, called Spock, has the task to gather as many as possible data streams delivered on the starship, combine it with the knowledge of a huge computer library and dr

Vulcan (Star Trek)

Vulcan (Star Trek) (Photo credit: Wikipedia)

aw conclusions of it, in real-time. In this series the logic and an ability to draw fast conclusions for the captain to make relevant decisions where key for survival.

In modern business the survival of companies depend on fast, exact, agile conclusions.  Modern technologies like the Chorus a product of Greenplum enables businesses of all sizes to gain insight on markets, customers, competition etc. was it in the past that this could be done on a long time frame today’s businesses move toward a continuous optimization and adoption of the GTM and their portfolios.

To enable an agile business process leader of companies have to gather as many streams of data around your business combine it with insight knowledge and make the tough decisions.

Specialists that turn this data into information where decisions will be drawn from so called data analyst, while the identifying of relevant data streams out of white noise is the job of a data scientist.

Of course today the time between analyze and decision-making is not quite short like it was often at the Enterprise, but the trend of more and faster data generation as well as access, more agile business grow as startups and compete with the established ones.

Looking on trends in IT departments of enterprises of all kinds, the desire for more agility leads to a cloud approach. This is only the first step, the last state is to be in the middle of the data universe and navigate their Enterprise thru the business solar system. The input will be overwhelming, new processes for sensors input needed to be developed and the crew aligned to the new command structure.

The engineering section, we would call it infrastructure, has to offer flexible and agile systems to answer the requests fast and right. One Key to success is automation, orchestration and standardization, and not dictation and a silo approach. Scotty will most probably fit into a data scientist role.

Star Trek: Phase II

Star Trek: Phase II (Photo credit: Wikipedia)

CIO´s will more become like captains to understand the challenges in this new space and align the crew and the rest of the ship to needs of the next decade. When cloud computing is the engine for agility, Big Data is the survival kit for the enterprise in the future. So Spock and Scotty are the two main assets of modern Enterprises  and James T. Kirk has drawn the right decisions from them, always.

Enhanced by Zemanta

BigData is Energy

Mankind is searching for energy since we have been crawl out o the sea. Naturally consuming various forms of energy to grow, to work to heat and other necessary items for life improvements. Over the time, we as a life form have achieved to collect more energy than we need for our basal metabolism.world_energy_300_clr.gif

So we started to invest into culture and leisure as well as technology. Understandable that this was not for all, but some. We started to trade and exchange this profit.

Nowadays-new forms of energy transports appeared like money or knowledge. Also in the last century we found enormous pools of energy, called oil and gas, nuclear as well as regenerative forms. This led to an incredible push in technology, trading and prosperity in parts of the world. While this happened the knowledge was one of the energy forms which was kept close and most nations and companies developed their own harvest of intellectual property (IP).

But than the Internet was born around 20 years ago. Knowledge was spread over the planet and an incredible innovation boost started. With now 7B people on this planet, knowledge is turned in to IP and the dimensions of this planet get captured in various methods. Mathematics cracks the complexity of our environment into formulas and we can understand the world we live in much better. Also more people have access to information, which centuries before was kept in libraries. So ideas can be born for demands never thought previously everywhere in the world.

With the social revolution of the Internet and the appearance of new devices, which make it easy for generations to feed the WWW with more data, pure knowledge got less important since all basic and complex questions seem to be answered with a tip of the fingers, or since recently, with a question to the iPhone. The requested data can now be seen in the best form mankind need to digest, reading, listening, watching; different form culture to culture. There are pictures, text, spoken, videos etc. However, the data is turned into information often in the brain of the user. Specialists have to explain the information and draw conclusions. Also all data or information is a snapshot in time. It has to be recreated often and frequently. This was not big issues years ago, but with the speed of chance happened in our business and life, more agile information was needs.

This is not the end. The Internet of things is approaching very fast and we see combing data from various sources produces new data. So where does this lead to: Big Data.

Another aspect becomes quite clear. Data has a value of energy, which depreciated over a while This energy is called Information. It depends on the data itself and may regain the energy level on alternative point in time. Like in auctions many data has a short, but powerful energy level, when the auction is running, before and after its value is much lower.

This is the power of BigData; it can leverage the combination of a huge amount of data and convert it in information, in real-time, structured and unstructured. The data itself is often not owned by an organization or individual, it is the combination of various sources. The value becomes thru the combination, realignment of new sources and optimization.


Imagine a prediction of a tsunami catastrophic earthquake, which has a huge value if the prediction is extreme high and the time before this happen is long. People recognizing strange behavior of animals, ground, etc is the collecting of data. As described before the energy level of this information is often only relevant if you have it in real-time and adjusted to new information on the fly.

This is where the thought of Big Data can help tremendous. It will let new information generation happen in an actual fusion, various asp


ects in parallel and also generate new data, which can be leveraged by another big data engine. Overtime the interpretation is key; facts will be done in instantaneous. Believe it or not with all the twitter messages, may most of them are useless for you, can be done a newspaper which is more accurate and neutral than ev
ery editor will ever be able to.

BigData will change the world; it is already staring. If it is done right the energy will be enormous and everywhere, not dependent on the culture, more on the people itself providing the fundamental data.