Job Title: Sr Lead AWS Big Data Developer
Location: Charlotte NC
Travel/Relocation/Remote: Remote till covid stabilizes
AWS Big Data Lead you will partner with our users and other data product teams to understand their needs and architect build impactful data analytics solutions You will lead the design and build of data pipelines to support applications and data solutions following software engineering best practices Responsibilities Work with development teams and other project leaders stakeholders to provide technical solutions that enable business capabilities Execute strategies that inform data design and architecture partnering with enterprise standard Architect design and develop data applications using big data technologies Hadoop AWS to ingest process and analyze large disparate datasets Build robust data pipelines on Cloud using Airflow Spark EMR Kinesis Kafka Lambda or other technologies Build the infrastructure required for optimal extraction transformation and loading of data from various data sources using SQL and AWS big data technologies Work with data and analytics experts to strive for greater functionality in our data systems Implement architectures to handle large scale data and its organization Execute strategies that inform data design and architecture partnering with enterprise standard Work across teams to deliver meaningful reference architectures that outline architecture principles and best practices for technology advancement Requirements BS in Computer Science Applied Mathematics Physics Statistics or area of study related to data sciences and data mining or relevant experience 5 years of solid development in big data stack and programming experience in Python and Scala 5 years of experience in data modeling data warehousing and big data architectures using Hadoop EMR spark Redshift Snowflake No SQL or similar large scale distributed systems 5 years of experience in a data engineering role to build Highly scalable large data pipelines Experience using JIRA and Agile Project Management software Experience with microservices development and Docker Kubernetes Core Competencies Hands on experience with the creation and automation of enterprise data pipelines and orchestration framework Spark Lambda on Cloud hybrid On prem deployment architecture Experience with orchestration framework like Airflow Deep expertise in at least one programming language Python Scala Strong experience with writing complex programs implementing architectures and enabling automation in these environments Experience in CI CD pipeline and code repositories like GitHub or Bit Bucket Proficient in application software architecture Definition Business Process Modeling etc DevOps experience with Terraform Data and ML pipeline experience Preferences Robust analytics and reporting skills hands on Experience in BI Tools like Tableau
• Batcheler’s degree
• 10+ Years of experience
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Click the following link for more information on your rights as an Applicant – http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.