Capping IT Off

Capping IT Off

Opinions expressed on this blog reflect the writer’s views and not the position of the Capgemini Group

Big Data is over the hype - can we get on with real work now?

Well that was fast, on the 7th of January I talk about killing the big data hype and then 15 days later over at Gartner one of their analysts, Svetlana Sicular, has said that Big data is over the hype curve.  Cause and effect?  Probably not as if you know big data you know that correlation != causation.  I rejoice that people are realising that the technologies behind Big Data, just like the technologies behind SOA, EAI and Data Warehousing didn't on their own deliver change so neither has a technology focus around Big Data delivered what companies wanted.  Its interesting that the blog talks about 'Hadoop' customers being disillusioned, at Capgemini we've consistently found over the years that clients who consider themselves to be technology centric in their transformation end up disillusioned that the technology isn't the silver bullet.

Back when I was doing lots of SOA work and vendors were talking about it purely in terms of 'Web Services' the biggest hurdle to get people to 'think' in a service-oriented way was the technology.  Vendors created a myth around point and click that sounded great but was in fact at best purely marketing.  With Big Data we have seen much of the same hype with everything in the world being able to be solved by the application of Hadoop. There was a slide that I used to use to describe this error, normally its about people, process and technology but personally I add mentality as changing people or re-organising them won't deliver the benefits if they don't start thinking in new ways.

Technology is not change

The reality is that these new technologies add new tools to the IT toolbox and enable new problems to be solved and old problems to be solved in better ways.  But what really delivers the change is a change in how technology is used and critically how it delivers value for a business.  Learning technologies is certainly useful, like learning a new foreign language, but like with new languages its about how you apply it that determines the value you get out.  If you are planning on expanding into Brazil then clearly learning Portugese is a good idea, but its the combination of that plan and the benefits that the language give you that deliver the full value, simply learning Portugese on its own is never going to mean you get sales in Brazil if you never intend as a business on going there.

Hadoop and other Big Data technologies along with Predictive Analytics are powerful tools but you only get value when you stop focusing on the technology and start focusing on the new outcomes you want to deliver.

I'm glad the hype is over. We can now get on with the real work.

About the author

2 Comments Leave a comment
kpadinja's picture
An absolute gem of an article!!.. but unfortunately articles like this are not in the mainstream view.. I like your picture Technology != Change..But when it comes to Big Data.. There is a new dimension to it.. and I don’t know if that is included in your 'mentality' aspect.. Big Data is not just processing massive data and coming out with Predictive analytics reports. Predictive analysis is all about looking for patterns.. it has a human factor to it..the ability to see the patterns in the analytic findings without bias.. there are many aspects and types of biases.. but the one that I am more interested is in the reduction of cognitive bias "human tendency to make systematic decisions in certain circumstances based on cognitive (e.g emotional) factors rather than evidence" .. in short the ability to remove the noise and get to the signal.. or in simple words the ability to connect the dots. Because this ability is very important, especially in Predictive Decision making. In that aspect Big Data is very different from other new technologies EAI or SOA or Social Media.. The challenges in prediction has been very well written by Nate Silver in his recent book “The Signal and the Noise: Why So Many Predictions Fail — but Some Don't.”
kpadinja's picture
in an intersting yammer post last.. we talked about changing " People, Process, Technology " triangle..and added a new dimension "Perspective".. that is the new aspect I forgot to mention above... Hope that is included in "mentality"

Leave a comment

Your email address will not be published. Required fields are marked *.