Hadoop - Senior Data Engineer

Company Name: Deloitte
Location: San Jose, CA
Date Posted: 12th Feb, 2018
Description:

Responsibilities

  • Understandsthe tradeoffs between different approaches to Hadoop file design
  • Experiencewith techniques of performance optimization for both data loading and dataretrieval
  • Experiencewith NoSQL Databases ‑ HBase, Apache Cassandra, Vertica, or MongoDB
  • Ableto translate business requirements into logical and physical file structuredesign
  • Abilityto build and test rapidly Map Reduce code in a rapid, iterative manner
  • Abilityto articulate reasons behind the design choices being made
Qualification:

Skills needed 

  • Strongdata analysis and SQL skills in Relational/Columnar/Big data environments(Joins, Union, rank, group by, order etc.)
  • Demonstrateexcellent written and verbal communication skills
  • Experiencewith Agile implementation methodology and working in a globally distributedteam structure
  • Able to work independently in a fast-paced environment
  • Experiencein Hadoop distributions (Apache / Cloudera / Hortonworks)
  • Abilityto deploy and maintain multi-node Hadoop cluster
  • Experienceworking with Big Data eco-system including tools such as Hadoop, Map Reduce,Yarn, Hive, Pig, Impala, Spark , Kafka, Hive, Impala and Storm to name a few
  • Knowledgeablein techniques for designing Hadoop-based file layout optimized to meet businessneeds

Required:

  • 6+ years of work experience
  • 3+ years working with Hadoop
  • Bachelor's Degree or equivalent work experience