Hadoop with Spark Developer – 4 to 6 Years – Bangalore location

Big Data with Spark – 4 to 6 Years – Bangalore / Mumbai

Job Responsibilities

1. Very good knowledge on Hadoop Eco system and its components;

2. Spark :;
a. Spark Architecture & its Features ;
b. Hand on experience on Spark Scala Language;
c. Very clear concepts on RDD , DF , Catalyst Optimizer , Tungsten etc.;
d. Hands on Experience Spark SQL s;
e. Sound Knowledge on Core Java concepts;

3. NoSQL :;
a. Should have sound knowledge on NoSQL Concepts .;
b. Proficient with one or more Apache Software Foundation Big Data & Database projects such as Cassandra, Hadoop, Hbase, MongoDB, Flume and etc.;
c. Proficient with Datamodelling on NOSQL;
d. Hands on Experience on NOSQL Databases as mentioned below;
i. Document databases ;
ii. Key/value stores ;
iii. Sorted ordered column-oriented stores;
e. Proficient with common developer tool sets such as Java, XML, JSON, REST, Shell, Perl and etc;
;
4. Hive : Hands on Experience in real time projects with deep knowledge but not limited to below;
a. DML Operations in Hive QL;
b. Partioniting and Bucketing in Hive;
c. Hive Operators;
d. Hive Built in Functions ;
e. Hive Joins ;
f. Hive Indexes;
g. Hive Metastore;
;
5. Pig : Hands on Experience in real time projects with deep knowledge but not limited to below;
a. Load and Store Operators;
b. Diagnostic Operators;
c. Grouping and Joining Operators;
d. Combining and Spitting Operators;
e. Filtering Operators;
f. Sorting Operators;
g. Pig Built-in Functions;
6. SQOOP : Hands on Experience in real time projects with deep knowledge but not limited to below;
a. Importing & Exporting Data using SQOOP ;
b. SQOOP Connectors for all major RDBMS Databases;
c. Incremental / Full Load using SQOOP;
d. Load data directly into HIVE/HBase suing SQOOP;
e. Compression using SQOOP;
;
Talend:;
Real-time development experience in Talend DI and Big Data tool with Spark.;
Hadoop and Hive knowledge is a must.;
Powershell scripting and Azure knowledge will be add on.;
Hands on experience on Talend 6.4 version.;
Data Migration experience is an added advantage.

Ref:

204598

Posted on:

September 14, 2018

Experience level:

Experienced (non-manager)

Education level:

Bachelor's degree or equivalent

Contract type:

Permanent

Location:

Mumbai

Department:

Business Information Management

cookies.

By continuing to navigate on this website, you accept the use of cookies.

For more information and to change the setting of cookies on your computer, please read our Privacy Policy.

Close

Close cookie information