Big Data Engineer

Company Name: Orzota, Inc
Location: San Francisco Bay Area, CA
Date Posted: 05th Apr, 2016


As a key member of a Big Data team you will be responsible for designing and developing major components of big data stream and batch processing applications. As a data engineer you should be familiar with and have hands-on experience with all aspects of big data engineering from data ingestion of various types of sources and common data cleansing and transformation techniques. Ability to develop, debug and deploy applications using common IDEs and agile methodologies is required.

  • Strong experience with object-oriented design, coding and testing patterns
  • Experience building big data solution using Hadoop technologies
  • 2+ years Java development experience
  • Strong knowledge of Linux and scripting
  • Solid understanding of SQL
  • Hands on experience using Map/Reduce, Hive and/or Pig
  • Experience using one or more of Kafka, Storm, Flume
  • Understanding of HDFS, Map/Reduce, HBase
  • Experience with stream processing technologies such as Storm/Spark is a plus
  • Experience with other technology such as Amazon EC2 is a plus
  • Ability to quickly triage and troubleshoot complex problems