Hadoop Developer

Company Name: San Diego, California
Location: The Cydio Group
Date Posted: 09th Jun, 2017

- Develop new processes to push data into and out of the Hadoop cluster

- Install and configure tools on top of the Hadoop environment to enable Analytics team to consume and analyze the data

- Develop in-house tools and processes to support internal requirements

- Support development of new reporting and modeling capabilities for client base


- 2+ years of experience with Hadoop and MapReduce is required

- Requires Experience with Cloudera

- Must have experience with Hadoop related tools such as: Pig, Spark, Impala, Kafka

- Experience working with scripting languages, including, but not limited to Python, Perl, Bash, or Powershell is required

- Requires experience with software development processes and version control systems

- Must have Java experience, preferably using Eclipse and Maven

- Requires proficiency with SQL

- Familiar with distributed systems (e.g. Service Oriented Architecture) is required

- Comfortable in either Windows or Linux is required

- Preferred 2+ years experience with multi-terabyte data management

- Experience with multiple IDE’s (Visual Studio, Eclipse, XCode, etc) is preferred

- Proficiency with multiple other programming languages such as: C#, C++, Python

- Experience developing automated processes (cron jobs, task scheduler, etc.)

- Expertise with XML technologies such as XPath and XSD and knowledge of XML parsing techniques such as SAX and DOM is preferred

- Experience developing and working with RESTful technology in multiple programming environments

- Experience with visualization tools is preferred

- Able to thrive in a fast-paced environment with minimal supervision and quickly learn new technologies.

- The ability to self-manage projects and document processes are all essential.

- Being passionate about big data development and pushing the envelope in using large volumes of data in ever-changing ways is key for this role.


- Required: Bachelor's degree in Computer Science, Engineering or Sciences