062982-Senior Software Engineer - Azure Data Engineer with Pyspark/Databricks

Role Description
•    Work closely with client technical heads, business heads, and business analysts to understand and document business and technical requirements and constraints.
•    Ability to implement ETL pipeline  using Databricks, Azure ADF ETL pipeline .
•    Experience in migrating batch ,streaming data from  On-Prem Hadoop/Oracle to Azure ADLS
•    Drive technical architecture meetings and help clients select the right architecture for their solutions that meet both functional and non-functional requirements today and in future.
•    Develop PoCs, strategies, and provide direction around data security, archiving, and retention, high availability, and disaster recovery.
 
Responsibilities:
•    Should have good hands on experience  in Azure ADF ,Databricks pipelines ,functions ,ADLS(Gen2)
•    Expert in Hadoop, Hive, sqoop, python, Pyspark, Scala spark , Kafka and other related big data related technologies and have related project experience.
•    Develop data standards, best practices, processes, and definitions of project and data requirements in support of strategy and ongoing operational support.
•    Expert in large distributed, high concurrency, high load system design, development, and optimization
•    Deliver scalable and reliable Big Data solutions leveraging Hortonworks HDP Hadoop platform, RDBMS,  SaaS platforms and APIs.
•    Apply concepts, industry research, best practices and agile methodologies and tools (Jira, Confluence) to implement Big Data solutions
 
Nice to have Skills
•    Azure Certifications (DP-200,DP-201).
•    Nice to Have knowledge of Machine Learning ,Python ,R and other Data science technologies
•    Knowledge of SAS language .

Behavioral Competency 
•    Ability to independently complete big data application architect design, framework design and optimization 
•    Strong verbal and written communication skills
•    Demonstrated ability to work in a demanding team-oriented environment
•    Highly effective communication and collaboration skills working in a distributed team environment
•    Technical leadership and strong independent problem-solving skills

Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development, Support and Deployment.    

Software Engineers perform requirements analysis.  They then design, develop or maintain the physical application (components) or the application environment, based on the Software Architecture (models and principles). Activities include coding, integrating, implementing, installing or changing frameworks and standard components, or technical and functional application management. A Software Engineer also develops languages, methods, frameworks and tools, and/or undertakes activities in support of server-based databases in development, test and production environments.

 

 

Required Skills and Experience:

 

 

You have mastered several Software Engineering areas, applications or database environments.  You act as a Software Engineering stream leader with technical delivery ownership within a (limited) number of technology areas. You contribute to bids or client proposals based on your technological expertise.  You also act as a team leader with delivery ownership, and guide individuals and groups towards desired outcomes. You actively participate in at least one community and contribute to community discussions.

 

 

• Qualification: 6 –  8 (2 years min relevant experience in the role), Bachelor’s Degree.
• Certification: Should have SE Level 1 and seeking level 2.
• Should be proficient in Business Analysis, Business Knowledge, Software Engineering, Testing, Data Management, Architecture Knowledge and Technical Solution Design.

 

 

In a world where change happens in a split second, our clients must master the art of balancing business transformation with operational excellence and cost reduction to protect their market leadership and safeguard their workforce.

They need the best and brightest talent to limit business disruption and foster future growth, all while striving to realize a new normal. In this context, it’s our people within Insights & Data that are the core enablers to support our clients in their growth journeys. To give our clients our best and brightest, we pride ourselves on being a fast-paced, fun, ethical place to work, where the “work hard, play hard” mentality holds true. Even more important is our clear commitment to creating a diverse workforce in all areas. In fact, for the ninth time in a row, Capgemini has been recognized as one of the World’s Most Ethical Companies by the Ethisphere Institute. In addition, we’ve been recognized as a top company for women by Working Mother Media.

Capgemini’s Insights & Data Americas practice is comprised of professionals with data, analytics, and AI expertise, covering the full data- and AI-powered transformation lifecycle. Our people extend into all industries we conduct work with our clients in the areas of; data science, data engineering, data strategy, intelligent process automation, data ecosystems, intelligent industry/IoT, enterprise management, customer-first marketing, and data partnerships/disruptors (such as SAP, Microsoft, Google, AWS, Snowflake, Oracle, Adobe, etc.).

We do great work at I&D that is at the forefront of innovation. We pride ourselves as an inclusive, talented, and accomplished workforce, so please contact us to explore your fit with us.

 

                                                                                               

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

 

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

  

 

 

Click the following link for more information on your rights as an Applicant - http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law     About Capgemini   With 270,000 women and men in nearly 50 countries, Capgemini is a responsible and multicultural global leader. Its purpose: unleashing human energy through technology for an inclusive and sustainable future. As a strategic partner to companies, Capgemini has harnessed the power of technology to enable business transformation for more than 50 years. The Group addresses the entire breadth of business needs, from strategy and design to managing operations. To do this, it relies on deep industry expertise and its command of fast evolving fields such as cloud, data, artificial intelligence, connectivity, software, digital engineering and platforms. In 2020, Capgemini reported global revenues of €17 billion.     Visit us at www.capgemini.com. People matter, results count.

Ref:

062982

Posted on:

March 31, 2022

Experience level:

Manager

Education level:

Bachelor's Degree (±16 years)

Contract type:

Regular

Location:

Toronto-

Business units:

IandD

Department:

CA013231

cookies.

By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.

Close

Close cookie information