- Working experience with Spark Hive Message Queue or Pub Sub Streaming technologies.
- Experience developing data pipelines using mix of languages Python Scala SQL etc and open source frameworks to implement data ingest processing and analytics technologies
- Experience leveraging open source big data processing frameworks such as Apache Spark Hadoop and streaming technologies such as Kafka
- PySpark, Python
- Excellent verbal and written communication and interpersonal skills
- Ability to work independently and within a team environment