Big Data Engineer

Job Description:

We are looking for Big Data Engineers for a Market Risk Analytics project in the Financial Sector. Our new colleagues will work on collecting, loading, transforming and analyzing huge sets of data and will contribute in designing and planning Big Data architecture and integration solutions by using cutting edge technologies in the Hadoop ecosystem.

Responsibilities:

  • Ability to scope and design  Big Data solutions independently based on high level architecture design
  • Selecting and integrating Big Data tools to provide a solution serving an analytics back end for the Risk Analytics project
  • Design and implement ETL processes for extracting, transforming and loading massive amounts of data into the Hadoop clusters
  • Provide analytics solutions on the Hadoop clusters by implementing complex  queries running in parallel and with high performance

Skills required:

  • Solid background in understanding the HDFS  distributed file system, the various tools and techniques of the Hadoop ecosystem, especially  in the Cloudera Hadoop distribution
  • Previous experience in Data Engineering projects and solutions in the Hadoop environment
  • Knowledge of Big Data related ETL tools and messaging systems such as Flume and Kafka
  • Understanding the  MapReduce and Spark Frameworks, experience in implementing components/queries using different Spark modules
  • Knowledge of Big Data Querying tools such as Hive, Pig and Impala
  • Experience with NoSQL databases like MongoDB, HBase
  • Ability to implement functional modules with Python and/or R programming languages using the Hadoop ecosystem frameworks

Languages: Intermediate/upper-intermediate in spoken and written English.

Why to choose us:

  • Internal trainings, virtual training environment where you can get to know individual technology solutions and applications
  • Participation in international projects in collaboration with experts from abroad
  • Competitive salary, cafeteria and other benefits
  • You can try your hand at different areas within the company
  • Friendly and modern work environment

Dreamjo.bs: https://dreamjo.bs/hu/company/capgemini-magyarorszag-kft?search=capgemini

Posted on:

September 17, 2018

Contract type:

Permanent Full Time

Location:

Budapest

cookies.

By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.

Close

Close cookie information