Apache Spark Developer

Company Name: IBM India
Location: United States
Date Posted: 24th May, 2018
Description:

 

  • Develop a modern, cloud based solution for a strategic initiative that enables IBM to more effectively and efficiently make business decisions based using your solution.
  • Your team's responsibility will be to create the working foundation of infrastructure and architecture design of the lar
  • ge scale, big data solution. This will include the development of the prototype through to a full operational system that many different teams (including yours) perform development within. 
  • You will also be responsible for selecting and using the DevOps tools for continuous integration, builds, and monitoring of the solutions.
  • You will join an exciting team, in an open landscaped, collaborative environment using agile delivery methods. Any experience in converting legacy ETL into the newer technologies is highly valued as well. 
     
Qualification:

Required Technical and Professional Expertise 

  • 1 year professional experience using Apache Spark and Kafka 
  • 2 years professional experience using Python 
  • 1 year professional experience using Parquet formats 
  • 2 years professional experience using ETL (extract, transform, and load) tools. 
  • 1 plus year of Cloud base architecture (for example: Bluemix or AWS development)
  • Demonstrated experience to work as part of an Agile team as a strong team player