Hadoop Developer for Insurance Client

Responsibilities

  • Providing engineering supports in coming projects and operations.
  • Supporting migration from Oracle to SQL server
  • Supporting database performance tuning with discussing with the client
  • Supporting engineering security inspections
  • Helping to Informatica developers on Hadoop issues
  • Basic Hadoop administration and job monitoring
  • Data Ingestion using Sqoop, automated python scripts
  • Sparking code development using Spark2.0 and scala for data transformation

Requirement

  • Experience and skills of migration from Oracle to SQL server using SQL Server Migration Assistant (SSMA)
  • Experience of testing and comparing data, database objects, and functions of before and after in migration of different database products
  • Experience of database performance tuning for Oracle and SQL Server
  • Experience of Database maintenance (software/hardware) to correspond to increase of SQL properties
  • Engineering skills for Database Audit
  • Working experience on Hadoop framework including HDFS, Hive, HBase, MapReduce, Pig, Oozie, Tez
  • Experience in Scala, Spark 2.0 and tools such as Eclipse or Intellij
  • Experience in RDBMS and SQL, Unix/Linux shell scripting, python and Java
  • Data transformation using spark, streaming

Language Proficiency:

  • Business level of English and Japanese

Location: Tokyo

Ref:

2020-JP-117

投稿日:

2021年01月08日

経験レベル:

Experienced (non-manager)

学歴レベル:

Bachelor's degree or equivalent

契約タイプ:

Permanent

勤務場所:

Tokyo

Department:

IT Solutions