Senior Data Engineer

Big Data Engineer

Job-Type- Full Time

Location- Canada (Remote)

Responsibilities

  • Senior Data Engineer to be part of our scrum teams and perform functional system development for Hadoop applications for our Enterprise Data Lake initiative
  • This is high visibility fast paced key initiative will integrate data across internal and external sources provide analytical insights and integrate with our critical systems Essential Responsibilities
  • Participate in the agile development process Develop functional and technical specifications from business requirements for the commercial platform
  • Ensure application quality and adherence to performance requirements
  • Help create project estimates and plans Represent engineering team in project meetings and solution discussions
  • Participate code review process Work with team members to achieve business results in a fast paced and quickly changing environment
  • Pair up with data engineers to develop cutting edge Analytic applications leveraging
  • Big Data technologies Hadoop NoSQL and In memory Data Grids Mentor and influence up and down the chain of command Support design strategy production promotion processes
  • DevOps software change control specifically related to Ab Initio as well as DW technology
  • Hands on Experience in building Ab Initio Graphs
  • Good Knowledge of Databases and hands on experience in writing SQL code Working experience with scheduling tools such as Autosys
  • Perform other duties and or projects as assigned

 

Qualifications

 

  • Bachelor s degree in a quantitative field such as Engineering Computer Science Statistics Econometrics and a minimum of 10 years of experience
  • Minimum 5 years experience working with and developing big data solutions
  • Experts in the following Ab Initio tools GDE Graphical Development Environment Co Operating System Control Center
  • Metadata Hub Enterprise Meta Environment Enterprise Meta Environment Portal Acquire It Express It Conduct It Data Quality Environment Query It
  • Hands on experience on writing shell scripts complex sql queries Hadoop commands and Git Ability to write abstracted reusable code components
  • Programming experience in at least two of the following languages Scala Java or Python Desired Characteristics Strong business acumen Critical Thinking and Creativity Performance tuning experience Experience in developing Hive Sqoop Spark Kafka HBase on Hadoop Familiar with Ab Initio Hortonworks Zookeeper and Oozie is a plus
  • Willingness to learn new technologies quickly Superior oral and written communication skills as well as the willingness to collaborate across teams of internal and external technical staff business analysts software support and operations staff
  • Strong business acumen 

Disclaimer

 

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Click the following link for more information on your rights as an Applicant - http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law

Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.

 

Ref:

1402007

Posted on:

September 8, 2022

Experience level:

Experienced (non-manager)

Contract type:

Permanent

Location:

Toronto

Business units:

FS

Department:

Financial Services

cookies.

By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.

Close

Close cookie information