Senior Data Engineer

Company Name: Instacart
Location: San Francisco, CA
Date Posted: 18th Oct, 2016

The ideal candidate is able to build and maintain a robust, scalable and sustainable enterprise data platform. Furthermore, s/he is well-versed in the best practices of data warehousing, but is flexible enough to think outside the box whenever necessary. The Data Engineer should be no stranger to high-scale systems with complex data models and large amounts data coming from various sources.

  • Work closely with the analysts and business stakeholders to gather technical requirements
  • Provide senior-level contribution to a team responsible for the design, implementation, deployment and maintenance of a multi-terabyte data platform
  • Contribute the continual improvement of the Instacart data platform via your observations and knowledge gained from your involvement and KPI's
  • Work in a collaborative environment -- meetings, iterative development and design and code review sessions
  • Expert level proficiency in SQL. Ability to perform complex data analysis with large volumes of data
  • Working experience with variety of data storage technology, including columnar databases and Hadoop ecosystem
  • Experience in data warehousing including dimensional modeling concepts
  • Proficiency in at least one of the scripting languages: Perl, Python or others
  • Real-time data pipeline construction (like Kafka) a plus
  • Machine learning experience a plus
  • Experience building consumer-facing data products (like recommendations or productionalized algorithms) a plus
  • Experience in object-oriented programming is a plus