Data Engineer

Company Name: Dailymotion
Location: New York, NYC
Date Posted: 15th Mar, 2017
  • Develop reusable tools for the management and manipulation of hundreds of terabytes of data
  • Build a user profiling system for ad profiling
  • Analyze and improve efficiency, scalability, and stability of data collection, storage, and retrieval processes
  • Interface with other teams to incorporate their innovations and vice versa
  • Work closely with data analysts to construct creative solutions for their analysis tasks
  • Optimize our infrastructure at both the software and hardware level
  • Ingest and store terabytes/ petabytes of data
  • Extensive experience working with large data stores 
  • Hands on experience with Spark, Spark Streaming, Kafka, Flume is very useful.
  • Advanced SQL query writing abilities and data understanding
  • Solid understanding of Distributed Computing Systems
  • Strong experience in developing and maintaining reliable ETL processes
  • Deep understanding of storage appliances and storage software internals
  • Experience with filesystems, server architectures, and distributed systems
  • Experience / Knowledge in Cloud Architectures
  • Ad Tech experience is a huge plus
  • Master’s Degree in Engineering or equivalent work experience required