Cloudera Data Engineer

 Role and responsibilities: 

The Data Engineer will consultant will work with product owners, platform users, integration team, quality analyst to develop, test and manage data engineering pipelines on various cloud platforms like Cloudera. Key responsibilities include

  • Develop efficient and reliable data pipelines consisting of diverse data sources to ingest and process data into cloud-based data platforms using Java as programming language
  • Integrate with batch and real time data ingestion from various source systems to cloud based data and analytics platform
  • Transform data using data mapping and distributed data processing capabilities like Spark etc
  • Collaborate with Security and Operations teams to develop and enforce proper data security and privacy practices
  • Work with stakeholders including the platform users and data analyst teams to assist with data-related technical issues and support their data infrastructure needs
  • Liaise with the multi-location teams, ensure quality of deliverables, facilitate user acceptance, support go-live activities and provide post go-live support


Qualifications and experience:  

  • Proven working experience as Big Data engineer with 5+ years preferably in building and supporting platforms with has Spring XD, Java/Mapreduce, Hive, Sqoop, Impala, Spark in Cloudera environment
  • Have good experience on Jenkins, Bit bucket, Jira and Github and databases Oracle, MySql, Sybase, Teradata as well as Dev frameworks – J2EE, Struts, Spring
  • Preferable if exposure to cloud environments like AWS, GCP
  • Ability to articulate/relate complex technology material to a variety of different types of stakeholders
  • Excellent social and communication skills, with a passion for mentoring and knowledge sharing 

Experienced in Agile / Scrum projects



Posted on:

July 30, 2021

Experience level:

Experienced Professional

Contract type:

Permanent Full Time



Business units:

I and D Global Business Line


Big Data & Analytics