Data warehouse optimisation using hadoop

Publish date:

A new solution from Capgemini, implemented in partnership with Informatica, Cloudera and Appfluent, optimises the ratio between the value of data and storage costs, making it easy to take advantage of new big data technologies. Today’s escalating data volumes can prevent Online Transaction Processing (OLTP) systems from generating and processing transactions efficiently which can cause […]

A new solution from Capgemini, implemented in partnership with Informatica, Cloudera and Appfluent, optimises the ratio between the value of data and storage costs, making it easy to take advantage of new big data technologies.
Today’s escalating data volumes can prevent Online Transaction Processing (OLTP) systems from generating and processing transactions efficiently which can cause Data Warehouse (DW) performance issues when querying data. Total Cost of Ownership (TCO), too, escalates rapidly because of the need for upgrades to DW hardware, and since licenses are priced according to volume. Organisations often pay to store information simply because they might need it.
Radically new capabilities are needed to enable DW and OLTP to function cost-effectively in this new environment. First, organisations need to cope with data volumes that traditional DW platforms (whether RDBMSs  or appliances) were never designed for. Second, they must deal with unstructured, semi-structured and structured data.
Big data technologies such as Apache Hadoop excel at managing large volumes of unstructured data. However, this data needs to be pulled together with structured data for analytical purposes.  As Big Data technologies and Apache Hadoop are coming into mainstream use, being able to integrate these new technologies with existing legacy Data Warehouse platforms to get the best of both worlds is key.
In partnership with Informatica, Cloudera and Appfluent, Capgemini has developed an integrated solution that allows OLTP systems and DWs to serve their primary functions efficiently and cost-effectively.

Data warehouse optimisation...

File type: PDF

Related Resources

Capgemini sponsored IDC Utilities’ New Business Models 2018

The Capgemini Global EUC sector commissioned IDC to conduct a study involving about 160...

Marketing disruption 3/7: Online customer feedback influences the customer journey – how firms can utilize it

Customers’ willingness to engage in dialogues has increased with the advent of social media,...

Marketing Disruption 2/7 : The proper use of language in online brand–customer dialogues – five steps for a successful online dialogue

Once brand–customer interactions moved online, they could take place anytime and anyplace. But...

cookies.

By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.

Close

Close cookie information