061616-Senior Software Engineer - Big Data Engineer - Python/Scala

•    Strong in Python/spark scripting, minimum 3+ yrs,
•    Must have hands on experience implementing AWS Big data lake using EMR and Spark.
•    Working experience with Spark, Hive, Message Queue or Pub/Sub, Streaming technologies (3+ years) 
•    Have 6+ years of experience developing data pipelines using mix of languages (Python, Scala, SQL etc.) and open source frameworks to implement data ingest, processing, and analytics technologies. 
•    Experience leveraging open source big data processing frameworks, such as Apache Spark, Hadoop and streaming technologies such as Kafka. 
•    Exposure  with newer technologies relevant to the data space such as Spark, Airflow, Apache Druid, Snowflake (or any other OLAP databases). 
•    Experience developing and deploying data pipelines and real-time data streams within a cloud native infrastructure preferably AWS 
•    Experience in using CI/CD pipeline (Gitlab)
•    Experience in Code Quality implementation (Used Pep8/Pylint) tools or any other code quality tool.
•    Experience of Python Plugins /operators like FTP Sensor, Oracle Operator etc.
•    Implement Industry Standards /Best Practices.
•    Excellent analytical and problem-solving skills
•    Excellent verbal and written communication skills   Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development, Support and Deployment.  

   

Software Engineers perform requirements analysis.  They then design, develop or maintain the physical application (components) or the application environment, based on the Software Architecture (models and principles). Activities include coding, integrating, implementing, installing or changing frameworks and standard components, or technical and functional application management. A Software Engineer also develops languages, methods, frameworks and tools, and/or undertakes activities in support of server-based databases in development, test and production environments.

 

 

Required Skills and Experience:

 

 

You have mastered several Software Engineering areas, applications or database environments.  You act as a Software Engineering stream leader with technical delivery ownership within a (limited) number of technology areas. You contribute to bids or client proposals based on your technological expertise.  You also act as a team leader with delivery ownership, and guide individuals and groups towards desired outcomes. You actively participate in at least one community and contribute to community discussions.

 

 

• Qualification: 6-8 years (2 years min relevant experience in the role) experience, Bachelor’s Degree.
• Certification: Should have SE Level 1 and seeking level 2.
• Should be proficient in Business Analysis, Business Knowledge, Software Engineering, Testing, Data Management, Architecture Knowledge and Technical Solution Design.

 

In a world where change happens in a split second, our clients must master the art of balancing business transformation with operational excellence and cost reduction to protect their market leadership and safeguard their workforce.
They need the best and brightest talent to limit business disruption and foster future growth, all while striving to realize a new normal. In this context, it’s our people within Insights & Data that are the core enablers to support our clients in their growth journeys. To give our clients our best and brightest, we pride ourselves on being a fast-paced, fun, ethical place to work, where the “work hard, play hard” mentality holds true. Even more important is our clear commitment to creating a diverse workforce in all areas. In fact, for the ninth time in a row, Capgemini has been recognized as one of the World’s Most Ethical Companies by the Ethisphere Institute. In addition, we’ve been recognized as a top company for women by Working Mother Media.
Capgemini’s Insights & Data Americas practice is comprised of professionals with data, analytics, and AI expertise, covering the full data- and AI-powered transformation lifecycle. Our people extend into all industries we conduct work with our clients in the areas of; data science, data engineering, data strategy, intelligent process automation, data ecosystems, intelligent industry/IoT, enterprise management, customer-first marketing, and data partnerships/disruptors (such as SAP, Microsoft, Google, AWS, Snowflake, Oracle, Adobe, etc.). 

We do great work at I&D that is at the forefront of innovation. We pride ourselves as an inclusive, talented, and accomplished workforce, so please contact us to explore your fit with us.
 

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
 
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
 
Click the following link for more information on your rights as an Applicant - http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
 
 
About Capgemini
 
Capgemini is a global leader in consulting, digital transformation, technology and engineering  services. The Group is at the forefront of innovation to address the entire breadth of clients’ opportunities in the evolving world of cloud, digital and platforms. Building on its strong 50-year+ heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is driven by the conviction that the business value of technology comes from and through people. Today, it is a multicultural company of 270,000 team members in almost 50 countries. With Altran, the Group reported 2019 combined revenues of €17billion.
 
Visit us at www.capgemini.com. People matter, results count.

Ref:

061616

Posted on:

March 3, 2022

Experience level:

Manager

Education level:

Bachelor's Degree (±16 years)

Contract type:

Regular

Location:

Brampton-

Business units:

IandD

Department:

CA013231

cookies.

By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.

Close

Close cookie information