Software Engineer

Job Responsibilities

We are looking to hire Bigdata Developer.

years of Exp – 4 to 6 yrs

Work Location – Bangalore

Job Description

The big data associate responsible for managing the full lifecycle of a Hadoop solution

This includes creating the requirements analysis the platform selection design of the technical architecture design of the application design and development testing and deployment of the proposed solution Analytical and problem solving  Good communication skill

Worked on Hadoop Hive Spark Spark Streaming Spark SQL Scala Kafka NiFi Sqoop Oozie

The candidate must have Scala Programming Writing high performance reliable and maintainable code in scala

Good experience on handling large datasets using Partitions Spark in Memory capabilities Broadcasts in Spark Effective efficient Joins Transformations and other during ingestion process itself

Good Experience in consuming messages from Kafka using Spark Streaming

Good Experience in transforming Spark Data Frames into JSON and publish the messages to Kafka Topic Performance tuning of spark applications for fixing right batch operations and memory tuning Data Science knowledge added advantage

Good experience on complete end to end code deployment process in Production

Ref:

368365

Posted on:

December 2, 2019

Experience level:

Experienced

Contract type:

Permanent

Location:

Mumbai

cookies.

By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.

Close

Close cookie information