6-8 years experience
� Development for data pipelines � ingestion, transformation, cleansing.
� Understanding the technical requirements of existing Data Platform and migration to Microsoft Azure cloud platform
� Design and build data pipelines to migrate large-scale data from existing on-premises data platform to Azure data lake using ADF
� Create data factory and linked services and new datasets in order to do the ETL jobs
� Create new data pipelines, debug existing data pipelines, trigger pipelines manually and trigger the pipeline on the schedule
� Data flow integration with external systems.
� Integration with data access tools and products..
� Experienced in Azure Cloud Platform (Azure Data Factory, HDI, CLI, Storage: ADLS and Blob, SQL Data Warehouse, Azure Functions, Azure Event Hubs, KAFKA).
� 3 or more years of hands-on experience in Spark/Scala development , Spark Streaming
� Hands-on experience (3+ years) with Azure Data Factory for creating Data Pipelines, debugging existing and incremental load to Azure Blob Storage, ADLS.
� Ability to deal with structured, semi-structured, unstructured and streaming data.
� 3-5 years of experience in ETL & data migration and processing and including relational databases (e.g., SQL Server, Oracle), Data warehousing, Big Data (Hadoop, Hive)
� Minimum 2 year of designing, building and operationalizing large scale enterprise data solutions and applications using one or more of Azure analytics services in combination with custom solutions – Spark, Azure Event Hubs, Azure DataFactory, ADLS, SQL DW, Azure Functions, etc.
Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development, Support and Deployment.
Software Engineers perform requirements analysis. They then design, develop or maintain the physical application (components) or the application environment, based on the Software Architecture (models and principles). Activities include coding, integrating, implementing, installing or changing frameworks and standard components, or technical and functional application management. A Software Engineer also develops languages, methods, frameworks and tools, and/or undertakes activities in support of server-based databases in development, test and production environments.
Required Skills and Experience:
You are an experienced Software Engineer. You have received training and mastered at least one technology environment. You are good at elaborating technology areas and have an ability to position them within the scope of an overall project. You are a member of at least one community.
� Qualification: 2 � 5 (1 year min relevant experience in the role) years experience, Bachelor�s Degree.
� Certification: Should have or seeking SE Level 1.
� Should have progressing knowledge in Business Analysis, Business Knowledge, Software Engineering, Testing, Data Management, Architecture Knowledge and Technical Solution Design.
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Click the following link for more information on your rights as an Applicant – http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
A global leader in consulting, technology services and digital transformation, Capgemini is at the forefront of innovation to address the entire breadth of clients� opportunities in the evolving world of cloud, digital and platforms. Building on its strong 50 year heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is driven by the conviction that the business value of technology comes from and through people. It is a multicultural company of 200,000 team members in more than 40 countries. The Group reported 2018 global revenues of EUR 13.2 billion. Visit us at www.capgemini.com. People matter, results count.