1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com

Principal System Admin, Hadoop - Engineer

Company Name: BNY Mellon
Location: Palo Alto ,California
Date Posted: 29th Aug, 2016
Description:

Installing, configuring and tuning Hadoop distributions: Hortonworks 

Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations 

Provide Infrastructure Recommendations, Capacity Planning 

Develop utilities to monitor cluster better 

Manage large clusters with huge volumes of data 

Perform Cluster maintenance 

Create and removal of nodes, cluster monitoring and troubleshooting 

Manage and review Hadoop log files 

Install and implement security for Hadoop clusters 

Install Hadoop Updates, patches and version upgrades. Automate the same through scripts 

Point of Contact for Vendor escalation. Work with Hortonworks in resolving issues

Qualification:

MS in Computer Science preferred, along with extensive hands-on experience in dealing with large data sets and distributed computing in data lake, data warehousing and business intelligence systems using hadoop 

Experience in installing, configuring and tuning Hadoop distributions: Hortonworks 

Experience around managing large clusters with huge volumes of data 

Experience with cluster maintenance tasks such as creation and removal of nodes, cluster monitoring and troubleshooting 

Strong knowledge of Linux 

Experience installing and implementing security for Hadoop clusters 

Conceptual/working knowledge of basic data management concepts like ETL, Ref/Master data, Data quality, RDBMS 

At least 3 years of experience with and strong understanding of ‘big data’ technologies in hadoop ecosystem – Hive, HDFS, Map/Reduce, Hbase, Flume, Pig, Cloudera, Hortonworks, Squoop, Zookeeper, Oozie, Spark, Kafka, Storm