hadoop/spark developer

Job Description


About Capgemini
With more than 211,300 people in over 40 countries, Capgemini is one of the world's foremost providers of consulting, technology and outsourcing services. The Group reported 2018 global revenues of EUR 13.2 billion. Together with its clients, Capgemini creates and delivers business, technology and digital solutions that fit their needs, enabling them to achieve innovation and competitiveness. A deeply multicultural organization, Capgemini has developed its own way of working, the Collaborative Business Experience™, and draws on Rightshore®, its worldwide delivery model.
Rightshore ® is a trademark belonging to Capgemini 

Role: Data Engineer Tech lead
Location: Chicago, IL
Position: Full time


Job description
We are looking for a Technical Data Engineer Lead to lead the development of consumer centric low latency analytic environment leveraging Big Data technologies and transform the legacy systems 
Lead a development team of big data engineers 
Implement a big data enterprise data lake BI and analytics system using Hive, Spark, Hadoop. 
Responsible for design advanced development testing oversight and implementation 
Works closely with program manager scrum master and architects to convey technical impacts to development timeline and risks 
Coordinate with data engineers and API developers to drive program delivery 
Drive technical development and application standards across enterprise data lake 


Qualifications Requirements 
BS in computer science or engineering degree 
Master degree preferred 
4 years experienced hands on working experience on Hadoop Spark Kafka MapReduce HDFS Hive Pig Sqoop Git and AB Initio 
3 years development experience with Agile Implementation and leadership experience across the technology stack 
Ability to lead and influence across departments and across levels of leaderships 
Proven ability to organize manage multiple priorities coupled with the flexibility to quickly adapt to ever changing business needs Excellent written and oral communication skills 
Adept and presenting complex topics influencing and executing with timely actionable follow through Strong analytical and problem solving skills with the ability to convert information into practical deliverables 
Uses rigorous logic and methods to solve difficult problems 
Experience working in real time data ingestion is required Experienced in sourcing and processing structured semi structured and unstructured data Experience in Data Cleansing Transformation Performance Tuning Experience in Storm Kafka and Flume would be a plus 
Hortonworks or Cloudera or MapR Certification would be a plus 
Basic knowledge of Big Data administration Ambari Desired Characteristics 
Extensive experience working with data big data platforms 
Demonstrated experience building strong relationships with senior leaders Strong leadership and influencing skills 
Outstanding written and verbal skills and the ability to influence and motivate teams



This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship. 

Click the following link for more information on your rights as an Applicant: http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law



Posted on:

July 15, 2019

Experience level:

Experienced (non-manager)

Education level:

Bachelor's degree or equivalent

Contract type:

Permanent Full Time



Business units:

I and D Global Practice


Financial Services


By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.


Close cookie information