Persyaratan
Persyaratan
- Experience in Hadoop stack, Spark, Scala ,HDFS, Hive,Sqoop, Zookeeper, Oozie.
- Expertise with the tools in Hadoop Ecosystem including Hive, HDFS, MapReduce, Sqoop, Spark, Kafka, Yarn, Oozie, Talend
- Hadoop Ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm
- Analytics : Big Data, Hadoop, Pig, YARN Cluster, HDFS Apache Spark.
- Languages: Scala, C, C++, Perl, Shell script, Java
- Database : Oracle, Hive
- Framework:Spark, Spring Boot, Hadoop, Kafka, scoop, Zookeeper, Oozie
Tanggung Jawab
- Coordination : coordination with Internal teams for daily operations work related
- Configuration : create and manage user accounts in Hadoop cluster and provide the necessary configurations to support projects or developments in Hadoop
- Administration : review data, control, and Job Tracker node performance and perform appropriate OS and Application level turning per Hadoop standard
- Monitoring : monitor and alert the customer Raw and usable disk and monitor daily reports and dashboards delivery
- Maintenance & support : Data gathering & data collection of Hadoop cluster/ecosystem
- Licence Management : Responsible to monitor Hadoop licenses
0 Comments