Hadoop Adminstrator

Company Name: United Health Group
Location: Boston
Date Posted: 26th Mar, 2018

Roles and Responsibilities

  • Supporting and augmenting our production and development Hadoop clusters, specifically Hortonworks
  • Capacity planning 
  • Managing resource utilization across competing business priorities
  • Monitoring and tuning cluster performance
  • Identifying opportunities to leverage components of the Hadoop ecosystems which are not yet part of our architecture
  • Assisting ETL developers in coding efficient data flows between customer data sources, internal databases and HDFS
  • Ensuring a high level of security and auditing around our Private Health Information data
  • Providing Hadoop expertise to various operational groups with varying skillsets, who will share admin responsibilities
  • Providing after-hours and weekend support for routine maintenance as well as troubleshooting outages.
  • Compliance with change control standards
  • Remaining current on the latest Hadoop technologies

Required qualifications:

  • Undergraduate degree in relevant subject or equivalent experience
  • 2 years' experience implementing data ingestion solutions using Kafka, Spark, and/ or NiFi
  • 4 or more years' administering or engineering Hadoop platforms (preferably HortonWorks)
  • Broad understanding of information technology topics including hardware, networking, architecture, protocols, file systems and operating systems
  • Familiarity with Java or Python development in a large organization