Big Data Developer - SPARK

Company Name: Ace Talent Curators
Location: New York, NY
Date Posted: 04th May, 2016

Big Data Applications Developer with a deep knowledge of Spark, Map Reduce and the Hadoop Ecosystem.This is a development role. As part of the team the candidate will work build cutting edge systems. We are looking for a person that wants to contribute to a robust team of developers, and continuously deepen the big data skills

  • Expertise with Hadoop and the HDFS and Ecosystem
  • Experience developing optimum strategies for distributing data over a cluster and distributed applications
  • Strong development skills on Map Reduce and Spark applications
  • Strong Experience with data management and partitioning
  • Experience in troubleshooting, debugging and optimizing Map Reduce
  • Experience working with Hortonworks or Cloudera (preferred)
  • Experience with batch processing
  • Experience with streaming processing
  • Experience in streams processing using Spark Streaming / Storm
  • Experience with Impala is a big plus
  • Experience with Core Java, Scala, Python, and R
  • Strong expertise on Relational Data Base Systems(SQL) and Hierarchical data management
  • Experience integrating a relational database and a NoSQL store and SQL applicationdevelopment experience
  • Exposure to ETL tools such as data torrent and Pentaho is a plus
  • Experience with Navigator is a plus
  • Experience with REST API is a plus
  • Exposure to encryption tools (HP Voltage) is a plus