Big Data Systems - Software Developer (Hadoop, Spark)

Company Name: Citi Bank
Location: Tampa, Florida
Date Posted: 06th Apr, 2017


  • Research of new/open source technologies that can assist with data processing architecture
  • Debugging installations and configurations
  • Considers issues relevant to building distributed systems (security, race conditions, CAP Theorem)
  • Diagramming Architecture

Creation of a system that can be easily handed off to support for BAU/Maintenance:

  • Documenting repeatable and testable installation procedures
  • Documentation of common troubleshooting techniques
  • Creating Monitoring and Alerting for system
  • Creation of Automated Repair Steps
  • Creating automated deployment of infrastructures
  • Statistical Analysis of data, primarily machines and processes.





Skills and competencies:

  • Java

  • Installing and configuring top level apache projects (Spark,HDFS, Hive, Impala, Solr, Elastic, Hue, Sqoop, Yarn, Zookeeper, Hbase, Kafka, Mesos, Phoenix, Zeppelin, Storm)

  • Shell Scripting

  • Python Scripting

  • SQL

  • Comfortable picking up a language enough to read open source software

  • Statistical Data Techniques

  • Cloud Infrastructure Design