Responsibilities
- Providing engineering supports in coming projects and operations.
- Supporting migration from Oracle to SQL server
- Supporting database performance tuning with discussing with the client
- Supporting engineering security inspections
- Helping to Informatica developers on Hadoop issues
- Basic Hadoop administration and job monitoring
- Data Ingestion using Sqoop, automated python scripts
- Sparking code development using Spark2.0 and scala for data transformation
Requirement
- Experience and skills of migration from Oracle to SQL server using SQL Server Migration Assistant (SSMA)
- Experience of testing and comparing data, database objects, and functions of before and after in migration of different database products
- Experience of database performance tuning for Oracle and SQL Server
- Experience of Database maintenance (software/hardware) to correspond to increase of SQL properties
- Engineering skills for Database Audit
- Working experience on Hadoop framework including HDFS, Hive, HBase, MapReduce, Pig, Oozie, Tez
- Experience in Scala, Spark 2.0 and tools such as Eclipse or Intellij
- Experience in RDBMS and SQL, Unix/Linux shell scripting, python and Java
- Data transformation using spark, streaming
Language Proficiency:
- Business level of English and Japanese
Location: Tokyo