Develop data pipelines and perform ETL using Big data technologies.
Perform as the functional and technical SME on Big Data
Work closely with client technical heads, business heads, and business analysts to understand and document business and technical requirements and constraints.
Develop PoCs, strategies, and provide direction around data security, archiving, and retention, high availability, and disaster recovery.
Mentor internal technical and business teams in understanding the overall client requirements and proposed Big Data Solution.
Experience in big data management products and solutions in a consulting capacity.
Minimum 1-2 yrs of experience with Pyspark development.
Expert in Hadoop, Hive, PlSql, shell scripting and other related big data related technologies and have related project experience.
Should have ability to optimize an existing Bigdata Solution.
Expert in large distributed, high concurrency, high load system design, development, and optimization
Deliver scalable and reliable Big Data solutions leveraging Hortonworks HDP Hadoop platform, RDBMS platforms and APIs.
Apply concepts, industry research, best practices and agile methodologies and tools (Jira, Confluence, Git) to implement Big Data solutions
AWS Knowledge/ Azure platform awareness and experience is highly desirable.
Cloudera or Hortonworks Certified.
Kafka streaming consumer implementation.
Agile based development experience is an asset.
Strong ability to independently complete big data application architect design, framework design and optimization.
Strong verbal and written communication skills.
Demonstrated ability to work in a demanding team-oriented environment.
Highly effective communication and collaboration skills working in a distributed team environment.
Technical leadership and strong independent problem-solving skills.
Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development, Support and Deployment.
Software Engineers perform requirements analysis. They then design, develop or maintain the physical application (components) or the application environment, based on the Software Architecture (models and principles). Activities include coding, integrating, implementing, installing or changing frameworks and standard components, or technical and functional application management. A Software Engineer also develops languages, methods, frameworks and tools, and/or undertakes activities in support of server-based databases in development, test and production environments.
Required Skills and Experience:
You are an experienced Software Engineer. You have received training and mastered at least one technology environment. You are good at elaborating technology areas and have an ability to position them within the scope of an overall project. You are a member of at least one community.
• Qualification: 3-7 years (2 years min relevant experience in the role) experience, Bachelor’s Degree.
• Certification: Should have or seeking SE Level 1.
• Should have progressing knowledge in Business Analysis, Business Knowledge, Software Engineering, Testing, Data Management, Architecture Knowledge and Technical Solution Design.
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Click the following link for more information on your rights as an Applicant – http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Capgemini is a global leader in consulting, digital transformation, technology and engineering services. The Group is at the forefront of innovation to address the entire breadth of clients’ opportunities in the evolving world of cloud, digital and platforms. Building on its strong 50-year+ heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is driven by the conviction that the business value of technology comes from and through people. Today, it is a multicultural company of 270,000 team members in almost 50 countries. With Altran, the Group reported 2019 combined revenues of €17billion.
Visit us at www.capgemini.com. People matter, results count.