Senior Hadoop Developer

About Capgemini

With more than 180,000 people in over 40 countries, Capgemini is a
global leader in consulting, technology and outsourcing services. The Group
reported 2015 global revenues of EUR 11.9 billion. Together with its clients,
Capgemini creates and delivers business, technology and digital solutions that
fit their needs, enabling them to achieve innovation and competitiveness. A
deeply multicultural organization, Capgemini has developed its own way of
working, the Collaborative Business Experience™, and draws on Rightshore®, its
worldwide delivery model.

 

Learn more about us at www.capgemini.com.

                                                                                           

Rightshore® is a trademark belonging to Capgemini

 

Job Title:  Senior Hadoop Developer

 

Job Duties:

  • The Senior/Lead Hadoop Developer is responsible for designing,
    developing, testing, tuning and building a large-scale data processing system,
    for Data Ingestion and Data products that allow the Client to improve quality,
    velocity and monetization of our data assets for both Operational Applications
    and Analytical needs.

  • Design, develop, validate and deploy the ETL processes

  • Must have used HADOOP (PIG, HIVE, SQOOP) on HORTONWORKS
    Distribution.

  • Responsible for the documentation of all Extract, Transform and
    Load (ETL) processes

  • Maintain and enhance ETL code, work with the QA and DBA team to
    fix performance issues

  • Collaborate with the Application team to design and develop
    required ETL processes, performance tune ETL programs/scripts.

  • Work with business partners to develop business rules and business
    rule execution

  • Perform process improvement and re-engineering with an
    understanding of technical problems and solutions as they relate to the current
    and future business environment.

  • Design and develop innovative solutions for demanding business
    situations.

  • Help drive cross team design / development via technical
    leadership / mentoring. Work with Offshore team of developers.

  • Analyze complex distributed production deployments, and make
    recommendations to optimize performance

Essential skills

  • Minimum 3 years ETL experience with RDBNS and Big Data strongly
    preferred, may consider experience with Informatica or Datastage as an
    alternate.

  • Minimum 2+ years of experience in creating reports using TABLEAU.

  • Proficiency with HORTONWORKS Hadoop distribution components and
    custom packages

  • Proven understanding and related experience with Hadoop, HBase,
    Hive, Pig, Sqoop, Flume, Hbase and/or Map/Reduce

  • Excellent RDBMS (Oracle, SQL Server) knowledge for development
    using SQL/PL SQL

  • Basic UNIX OS and Shell Scripting skills

  • 6+ years’ experience in UNIX and Shell Scripting.

  • 3+ years’ experience in job scheduling tools like AutoSys.

  • 3+ years’ experience in Pig and Hive Queries.

  • 3+ years’ experience Hand on experience with Oozie.

  • 3+ years’ experience in Importing and exporting the data using
    Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.

  • 3+ years’ experience in Importing and exporting the data using
    Sqoop from HDFS to Relational Database systems/Teradata and vice-versa.

  • Must have 2+ Experience in working with Spark for data
    manipulation, preparation, cleansing.

 

Capgemini is an Equal Opportunity Employer encouraging diversity in the
workplace. All qualified applicants will receive consideration for employment
without regard to race, national origin, gender identity/expression, age,
religion, disability, sexual orientation, genetics, veteran status, marital
status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and
Qualifications required for this position. Physical, mental, sensory or
environmental demands may be referenced in an attempt to communicate the manner
in which this position traditionally is performed. Whenever necessary to
provide individuals with disabilities an equal employment opportunity,
Capgemini will consider reasonable accommodations that might involve varying
job requirements and/or changing the way this job is performed, provided that
such accommodations do not pose an undue hardship.

 

Click the following link for more information on your rights
as an Applicant:
http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law