Hadoop Jobs in USA

Know How to Bag the Latest Hadoop Jobs in USA

You have learnt Hadoop, you know a lot about Big Data, and you have invested hours, days and months of your life understanding how Hadoop tames Big Data. You are ready to begin your career as a Hadoop Developer or a Hadoop Admin. You have even prepared the top Hadoop interview questions that might come in these job interviews. But most people miss out on a crucial part of their Hadoop learning , that is - researching open Hadoop job positions in the market.

Yes, it is very important to research this on your own!

Current Hadoop Job Openings

hadoop-job-img

Senior Programmer Analyst-ISD (Big Data/Hadoop)

company-icon Walmart

   BENTONVILLE
   06th Dec, 2017
Job Description:

Job Responsibilities -

  • Creates and delivers presentations on application solutions to diverse audiences (for example, suppliers, technical staff)
  • Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans
  • Develops associate capabilities
  • Leads efforts to increase Information Systems Division (ISD) team effectiveness
  • Manages product installation upgrades (for example, Information Systems Division (ISD) application solutions, third-party products)
  • Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity
  • Participates in team projects
  • Provides and supports the implementation of business solutions
  • Provides complex application solutions
  • Supports Information Systems Division (ISD) applications
hadoop-job-img

Big Data Engineer

company-icon ClimaCell

   Boston, MA
   05th Dec, 2017
Job Description:

Job Responsibilities -

  •  Build the infrastructure and the core algorithms used by the company.
  • You’ll be pioneering a cutting-edge solution to process massive amounts of data in real time, at an order of magnitude higher spatial and temporal resolution than is possible with competing technologies.
  • If you love programming as much as analyzing data, then this job is for you.
hadoop-job-img

Big Data Engineer

company-icon Zaplabs

   Emeryville, CA, US
   29th Nov, 2017
Job Description:
  • You’ll be responsible for designing and building high performance, scalable solutions for large volume data ingestion, clean-up, and processing that meet the needs of millions of agents, brokers, home buyers, and sellers.
  • You’ll design, develop, and test robust, scalable microservices, Spark Streaming Applications, and RESTful web services.
  • You’ll work with a variety of teams and individuals, including product engineers, to understand the MLS and other real estate related data pipeline needs and come up with innovative solutions.
  • You’ll be a self-organized member of a team of talented engineers and collaborate with product managers and designers to help implement and execute new products and features.

More Hadoop Jobs

hadoop-job-img

Sr. Java/Hadoop Developer

company-icon Delta System & Software Inc

   Dearborn, MI
   22nd Nov, 2017
Job Description:

Job Responsibilities 

• Design and development of data ingestion pipelines.

• Perform data migration and conversion activities.

• Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.

• Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).

• Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.

hadoop-job-img

Senior Hadoop Developer

company-icon Auto Club of Southern California

   Costa Mesa, CA
   22nd Nov, 2017
Job Description:

Job Responsibilities -

* Build SQL/HIVE databases and tables.

* Define technical requirements, performance tuning, analytical and business user support.

* Write PIG scripts, as well as develop data integration and ingestion processes.

* Architect data pipelines and integrations with internal and external sources.

* Build job automation and scheduling using Control-M, unit and system testing.

hadoop-job-img

Hadoop Engineer

company-icon eBay

   San Jose, CA
   14th Nov, 2017
Job Description:

Job Responsibilities -

  • Be part of the mission to contribute into and enable the next generation Hadoop Platform at eBay.
  • Work in small groups of extremely talented and dedicated engineers in a fast-paced agile environment.
  • Design and implement differentiated production-grade features related to security, high availability and multi-tenancy.
  • Ability to contribute into open source projects while delivering value to ebay
hadoop-job-img

Big Data Framework Developer

company-icon Apple

   Santa Clara Valley, CA
   10th Nov, 2017
Job Description:

Responsibilities-

  • Architect, design and build a Big-Data Framework that provides proper abstractions for common building blocks of big data analytics systems. The abstractions will be optimally assembled into data processing and machine learning pipelines in an easy to use manner by developers and end business users. This framework should make Big-Data Technology agnostic to the users, so users can concentrate on the business logic.
  • The framework will have a clear distinction about the cold data, warm data and hot data, and the framework, while serving the user with a unified interface, has the ability to move the data behind the scene transparently. Essentially the framework is to implement the tiered storage architecture.
  • The framework will federate the data from different systems where the data is retrieved in parallel from those systems.
  • Designs and develops the features to address the above stated requirements Designs Self - Serve data structures, sets up the Data Pipe Lines for these structures;
  • Schedules the data pipe lines for daily and history processing; Works closely with cross functional teams to gather requirements.
hadoop-job-img

Application Specialist with Hadoop and Java

company-icon ScotiaBank

   Toronto, ON
   05th Nov, 2017
Job Description:

KEY ACCOUNTABILITIES:

  • Produce Solution Architecture Documents by working with security, infrastructure, and Architecture teams. 
  • Help the development teams with application solutions, suggesting and evaluating technology, development process improvement.
  • Help create a technology roadmap for the department.
hadoop-job-img

Senior Big Data Developer

company-icon AAA East Central

   Costa Mesa, CA
   04th Jul, 2017
Job Description:

* Defining technical requirements, architecting data pipelines and integration routines with internal/external sources.

* Developing data integration/ingestion processes.

* Building SQL/HIVE databases and tables.

* Writing PIG scripts.

* Job automation and scheduling using Control-M, unit and system testing.

* Performance tuning and analytical and business user support.

hadoop-job-img

Big Data ETL Developer

company-icon DoubleVerify,Inc.

   New York, NYC
   04th Jul, 2017
Job Description:
  • Developing ETL processes that process billions of records a day efficiently
  • Delivering insightful data to clients, partners and internal users in various ways by implementing robust, scalable data delivery applications and APIs.
  • Collaborating and participating in project meetings.
  • Analyzing data to test the correctness and effectiveness of ETL processes.
hadoop-job-img

Big Data Developer

company-icon Perficient

   US-CO-Denver
   26th Jun, 2017
Job Description:
  • Participate in technical planning & requirements gathering phases including Design, code, test, troubleshoot, and document engineering software applications.
  •  Ensuring that technical software development process is followed on the project, familiar with industry best practices for software development.
  • Demonstrate the ability to adapt and work with team members of various experience level
  • End-to-End Cloud Data Solutioning and data stream design, experience with tools of the trade: Hadoop, Spark,Storm, Hive, Pig, AWS (EMR, Redshift, S3, etc.)/Azure (HD Insight) and Data Lake Design
  • Build Large Scale, Fault Tolerance Systems with components of scalability, and high data throughput with tools like Kafka, Storm, Flink, and Spark, and NoSQL platforms like HBase and DataStax
  • Build NoSQL solutions and capacity for understanding Graph, Key Value, Tuple Store, Columnar Memory, and in-memory functionality

 

hadoop-job-img

Geospatial Java/Big Data Developer SJ/AU

company-icon VISA

   Austin, Texas
   24th Jun, 2017
Job Description:

Responsibility level 


• Exercises independent judgment with minimal direction from supervisor.

• Design, develop, document and implement new programs and subprograms, as well as enhancements, modifications, and corrections to existing software. 
• Develop testing and debugging routines and oversee execution. 
• Create documentation and procedures for installation and maintenance. 
• Build and maintain relationships with global and virtual teams and third parties on software development or support issues. 
• Lead development and oversee programming and testing functions to ensure that projects are securely delivered and fulfill expectations. 
• Understand the positioning of a solution within the company and to build a plan to effectively gain buy-in from all participants. 
• Identify opportunities for further enhancements and refinements to standards and processes. 

hadoop-job-img

Data Architect

company-icon Karsun Solutions LLC

   US-DC-Washington
   23rd Jun, 2017
Job Description:

Responsibilities:

  • Serves as the technical and technology expert supporting the database architecture and guide the management and improvement of the database solutions.
  • Responsible for overseeing data design models, database architecture and data repository design, in addition to creating and testing various database prototypes.
  • Reviews proposed enhancements to validate feasibility and assists with scoping and estimating work such as cloud migration, commercial RDBMS to open source.
  • Assist project managers in setting schedules for new technology adoption and prepare technical roadmaps
  • In coordination with stakeholder & developers, continuously monitors and analyze solution fitness, while looking for ways to refactor and continuously improve the services.
  • Ensures strategies, standards, and architecture are consistent and well integrated across products.
  • Develop technical prototypes in various technologies including on database servers, application servers, libraries, and frameworks
  • Advise customers on technical tradeoff of different approaches
  • Help application developers to adopt new platforms through documentation, training, and mentoring
  • Differentiate and balance customer & engineering side cultures
  • Keep skills up to date through ongoing self-directed training
hadoop-job-img

DATA ENGINEER

company-icon Aerospace

   El Segundo, CA (California)
   17th Jun, 2017
Job Description:
  • Work with other members of the department to build products for US government customers that deliver real-time analytics
  • Build Data pipelines to clean "messy" data and help build standards in data cleaning for analytical studies
  • Build Data Frameworks for studies that require the aggregation of many different technical databases that may include text, images, and numerical data
  • Build fast Machine Learning pipelines that are ready for production
  • Provide backup to lead web application developer on backend development
  • May participate on studies and analyses requiring research and synthesis of technical and programmatic data

 

hadoop-job-img

Hadoop Developer

company-icon Verizon

   Palo Alto, CA
   15th Jun, 2017
Job Description:
  • Hands on contribution to biz logic using Hadoop echo system (Java MR, PIG, Scala, Hbase, Hive)
  • Work on technologies related to NoSQL, SQL and InMemory platform(s)
hadoop-job-img

Hadoop Developer

company-icon The Cydio Group

   San Diego, California
   15th Jun, 2017
Job Description:
  • Develop new processes to push data into and out of the Hadoop cluster
  • Install and configure tools on top of the Hadoop environment to enable Analytics team to consume and analyze the data
  • Develop in-house tools and processes to support internal requirements
  • Support development of new reporting and modeling capabilities for client base
hadoop-job-img

Hadoop Developer

company-icon San Diego, California

   The Cydio Group
   09th Jun, 2017
Job Description:

- Develop new processes to push data into and out of the Hadoop cluster

- Install and configure tools on top of the Hadoop environment to enable Analytics team to consume and analyze the data

- Develop in-house tools and processes to support internal requirements

- Support development of new reporting and modeling capabilities for client base

hadoop-job-img

Hadoop Developer

company-icon Forrester

   Cambridge, Massachusetts
   04th Jun, 2017
Job Description:
  • Architect and implement data analytics solutions on big data batch and stream processing frameworks (e.g. Hadoop, Spark, etc).
  • Partner with business representatives, business analysts, and developers, and DBAs to deliver comprehensive business-facing analytics solutions.
  • Write code to explore problems and understand data, and ability to implement solutions from scratch using machine learning fundamentals and algorithms.
  • Use data from several data sources to support solution features, train and drive test models.
  • Ability to design and implement RESTful APIs to expose data, or integrate with external web services.
  • Responsible for building, maintaining and documenting the overall solution.

 

 

 

hadoop-job-img

Hadoop Developer

company-icon Bank of America

   Plano, TX, United States
   03rd Jun, 2017
Job Description:

• Have a good understanding of the E2E process of the application

• Work with the Business Analysts to understand the enhancements / changes being propagated in a particular release cycle, design and work on the coding & unit testing tasks

• Work with the QA team during the SIT phase and support the SIT

• Work with Platform Support team during UAT phase

• Identify improvement areas within the application and work with the respective component teams to implement the same

• Working knowledge of any one or more of the following databases – Netezza, Teradata, Oracle, SQL Server

 

 

hadoop-job-img

Hadoop Developer

company-icon Resolvit

   Cincinnati Ohio
   02nd Jun, 2017
Job Description:
  • Participate in test planning, development, and execution for integration and system testing
  • Develop, implement, and administer through a Big Data platform
  • Learn new software tools and skills as needed
  • Promote opportunities for enhancements and process improvements
  • Provide accurate and timely management status of work activity
  • Provide accurate and timely reporting of work hours
  • Establish strong working relationships with teammates and others within organization
  • Provide production support during and after business hours, as needed
  • Participate in the local Hadoop tech meetups community
  • Work directly with external vendors to resolve issues and perform technical tasks
hadoop-job-img

Tech Lead- Java Big Data

company-icon Credit Suisse

   United States-NC-Raleigh
   31st May, 2017
Job Description:
  • This is a senior technical lead role to work across all product lines in the bank.

  • You will have ownership of project delivery, plan sprints and work with the team to deliver the project.

  • Analyze the business requirements and convert them into detailed program logic. Opportunity to collaborate with senior leads across risk and finance.

  • You will design complex solutions, develop, test, and implement the application as individual contributor or drive a team of senior developers to deliver projects on time.

  • To effectively respond to technical queries / requests from team members and customers.

  • Communicate regularly with business and I.T leadership teams.

  • Have the chance to work with big data technologies with complex use cases.

 

hadoop-job-img

Geospatial – Java/Big Data Developer SJ/AU

company-icon VISA

   Austin, Texas
   30th May, 2017
Job Description:
  • Exercises independent judgment with minimal direction from supervisor
  • Design, develop, document and implement new programs and subprograms, as well as enhancements, modifications, and corrections to existing software. 
  • Develop testing and debugging routines and oversee execution. 
  • Create documentation and procedures for installation and maintenance. 
  • Build and maintain relationships with global and virtual teams and third parties on software development or support issues. 
  • Lead development and oversee programming and testing functions to ensure that projects are securely delivered and fulfill expectations. 
  • Understand the positioning of a solution within the company and to build a plan to effectively gain buy-in from all participants. 
  • Identify opportunities for further enhancements and refinements to standards and processes
hadoop-job-img

Hadoop Developer

company-icon Intellisoft Technologies

   Dallas, Texas
   20th May, 2017
Job Description:

Responsibilities

  • Data ingestion, processing, and modeling
  • Folder management
  • Metadata maintenance
  • File compaction and maintenance
  • Performance reliability
  • Produces technical documentation (in code and through technical documentation)
  • Experienced working in the Azure IaaS space
  • Experience in code/build/deployment tools (VSTS)
  • Experience with StreamSets is a plus
hadoop-job-img

Developer Big Data

company-icon Wipro Analytics

   O Fallon - Missouri
   16th May, 2017
Job Description:

You are responsible for development, support, maintenance and implementation of a complex project module. You should have good experience in application of standard software development principles. You should be able to work as an independent team member, capable of applying judgment to plan and execute your tasks. You should have in-depth knowledge of at least one development technology/ programming language. You should be able to respond to technical queries / requests from team members and customers. You should be able to coach, guide and mentor junior members in the team.

 

hadoop-job-img

Big Data Developer Job

company-icon SAP

   Dublin, CA
   12th May, 2017
Job Description:
  • Develop software prototypes based upon a high level use case and persona
  • Quickly learn new development languages if required
  • Work in a very unstructured environment where activities and tasks change frequent.
  •   Have a very good understanding of software programming and the ability to “pick up” new programming languages quickly.
  •   A good understanding of big data and Hadoop
  •    Continually enhance your existing skills and seek new areas for personal development
  •    Be a strong, committed, reliable team player; as well as being a proactive networker, and  self-starter
hadoop-job-img

Hadoop Developer

company-icon RangTech

   Piscataway Township, NJ
   10th May, 2017
Job Description:

Responsibilities:

· Hadoop development and implementation.

· Loading from disparate data sets.

· Pre-processing using Hive and Pig.

· Designing, building, installing, configuring and supporting Hadoop.

· Translate complex functional and technical requirements into detailed design.

· Perform analysis of vast data stores and uncover insights.

· Maintain security and data privacy.

· Create scalable and high-performance web services for data tracking.

· High-speed querying.

· Managing and deploying HBase.

· Being a part of a POC effort to help build new Hadoop clusters.

· Test prototypes and oversee handover to operational teams.

· Propose best practices/standards.

 

 
hadoop-job-img

Big Data Developer

company-icon Bank of America

   Chicago, IL
   09th May, 2017
Job Description:

Responsible for developing, enhancing, modifying and/or maintaining applications in the Global Markets environment. Software developers design, code, test, debug and document programs as well as support activities for the corporate systems architecture. Employees work closely with business partners in defining requirements for system applications. Employees are expected to have in-depth capital markets product knowledge, and manage a high level of risk.

hadoop-job-img

Big Data Engineer

company-icon ZeniMax Media

   Rockville, MD, Hunt Valley, MD or Austin, TX, US
   01st May, 2017
Job Description:
  • Work within the Enterprise BI team, supporting the creation of data pipeline processes for ingesting data at large scales
  • Work directly with Data Modelers, Enterprise Architect, and Analysts, ensuring that business requirements are being met
  • Directly work with the Data Engineers and Data Modelers to understand the source and target structures
  • Coordinate with the analysts and report developers to ensure data can be easily digested by Business Intelligence tools
  • Be able to straddle differing subject areas such as in game vs business data sources
hadoop-job-img

Hadoop Developer

company-icon Caterpillar

   Peoria, IL
   16th Apr, 2017
Job Description:
  • Performs all duties without close supervision. However, more complex assignments may require closer supervision and assistance. 
  • Designs, codes, tests, and debugs programs of varying degrees of complexity. 
  • Works directly on application/technical problem identification and resolution, including off-shift and weekend support functions. 
  • Works independently on complex modules that may be used by one or more programs or applications. 
  • Works independently on complex projects that may span multiple infrastructure components. 
  • Under the direction of more senior staff, assists in the development of major application modules and programs. 
  • Participates in integrated testing and user acceptance of application or infrastructure components. 
  • Works with vendors on the integration of purchased application and/or infrastructure solutions. 
  • Assists less senior staff with logic problems and interpretation of specifications. 
  • Fully knowledgeable of programming languages appropriate to the platform supported, program design and specification development, programming logic, logic diagrams, basic system analysis techniques, testing, debugging, documentation standards, file design, storage and internal systems. 
  • Designs and implements processes, or process improvements, to aid in development and support.
hadoop-job-img

Hadoop Developer

company-icon United Health Group

   Richardson, Texas
   14th Apr, 2017
Job Description:

Primary Responsibilities:

  • Deploy and manage business technology solutions and applications, analytical technology solutions
  • Consult with internal customer teams
  • Manage technology solutions portfolios, and identifying new technology approaches to solve business problems with a strong focus on leveraging enterprise data in our Hadoop data lake and compare facilities
  • Enable analytics partners to investigate, research, and analyze transactional data
  • Combine their technical expertise with the ability to architect, deploy, and oversee integrated analytics/business technology solutions
  • Contribute to the building and management of the analytics infrastructure for the Advanced Research & Analytics (ARA) team
  • Manage internal engagements, meeting project and deliverable timelines, ensuring the accurate and timely completion of deliverables
  • Work with Analytics Directors on staffing needs, strategic technology trend identification, monitoring project progress and completion, issue resolution and technical solutions related to data, data flow and advising on algorithm deployment
  • Deploy and oversee end-to-end analytics and data technology capabilities
  • Manage big data infrastructure including data processes; acquisition, storage, transformation, and analysis
  • Establish technology strategies, team direction, resolve problems and provide guidance to members of own team
  • Adapt departmental plans and priorities to address business and operational challenges
  • Make product, service or process decisions likely to impact multiple groups of employees and/or customers (internal or external)
  • Collaborate with analytics practitioners, business analysts and methodologists to design and oversee the development of working prototypes of technical solutions
  • Facilitating the creation of complex statistical statements on healthcare data that measures various aspects of healthcare services, consumer episodes, and operational events
  • Prioritize and manage an analysis plan and several technical work streams in support of UHC initiatives and programs
hadoop-job-img

Hadoop Developer

company-icon Bond Street Group

   New York, NYC
   09th Apr, 2017
Job Description:
  • Provide technology solutions that address business needs by developing applications within
  • technology environments
  • Knowledge of design patterns and best practices for high performance, scalable, extensible
  • applications
  • Caching techniques
  • Ability to define interfaces that can be implemented by the programming team
  • Contribute to the technical code documentation
  • Design, develop, and implement code
  • Implement fixes and enhancements
  • Create Test Plans, Test Cases and perform unit and integration testing
  • Support existing applications
  • Involved in full life cycle of project
  • Good Technical Writing skills
  • Excellent Communication and Interpersonal skills.
hadoop-job-img

Hadoop Developer/Adminstrator

company-icon PKW Associates

   Reston, VA
   08th Apr, 2017
Job Description:
  • Develop APIs and Services, write code and scripts as needed in Java.
  • Work with the BigMatch correlation team to configure and adapt the correlation algorithm which works against data in HBase.
  • Analyze system performance, make recommendations to improve performance, and implement those recommendations once approved.
hadoop-job-img

Hadoop Developer

company-icon Photon

   Deerfield, IL
   03rd Apr, 2017
Job Description:
  • Provide analytical insights associated with strategic Merchandising initiatives including understanding root cause and proposing potential solutions
  • Provide business insights, while leveraging internal tools and systems, databases and industry data
  • Assist/Perform advanced analytics such as demand analysis, price elasticity, and customer behavior
  • Lead and Complete complex analytical topics to broad audience of peers and management teams.
  • Minimum of 8+ years’ experience, including 3+ years in retail business
  • Excellent written and verbal communication skills for varied audiences on analytical subject matter
  • Demonstrated ability to transform business requirements to specific analytical reports and tools
  • This role will involve analytical modeling, root cause analysis, investigation and collaboration with the business partners as well as building analytical structure and framework
hadoop-job-img

Hadoop Developer

company-icon CloudBigData Technologies

   Dallas, Texas
   02nd Apr, 2017
Job Description:

Responsibilities :

  • Selecting and integrating Big Data tools and frameworks required to provide requested capabilities
  • Implementing Data ingestion and ETL processes on Hadoop
  • Monitoring performance and advising any necessary infrastructure changes
  • Defining data retention policies
  • Design and build data processing pipelines for structured and unstructured data using tools and frameworks in the Hadoop ecosystem
  • Develop applications that are scalable to handle millions of events/records
  • Design and launch scalable, reliable and efficient processes to move, transform and report on large amounts of data.
hadoop-job-img

Lead Hadoop Application Developer

company-icon RBC

   Toronto, ON, CANADA
   02nd Apr, 2017
Job Description:
  • Focusing specifically on Wealth Management and Insurance Business Units
  • Understanding the wide variety of data in the space and closely collaborating with the respective technology teams providing Hadoop Development expertise.
  • As a senior Developer, the incumbent is expected to solve hard problems constrained by response times, consistency and accuracy, high availability, user experience, ease of use and scalability while addressing specific business needs within Wealth Management and Insurance Business units.
hadoop-job-img

Sr. Hadoop Developer

company-icon INSYS Group

   Newark, NJ
   24th Mar, 2017
Job Description:

Responsibilities

* Analyze business requirements then design & develop applications to support them, suggesting the innovative use of newer technologies where appropriate.

* Understand & follow the complete agile SDLC methodology.

* Build and maintain positive relationships with internal clients & IT co-workers.

* Possess excellent oral and written communication skills.

* Have the ability to manage multiple tasks and projects simultaneously.

* Possess the ability to associate past experience with current events in order to resolve problems or generate new ideas.

* Develop & execute test scenarios ensuring the stability/performance of applications.

hadoop-job-img

Senior Hadoop Developer w/ Java & Multi-threading

company-icon TEKREQS, Inc.

   New York, NYC
   24th Mar, 2017
Job Description:

Responsibilities:
- Take ownership of a component of the Query Language (QL), Pricing History or Data Platform (DP) platform.
- Interact with development teams across the firm and understand their software/application requirements and data access patterns.
- Design and develop Distributed systems that meet the firm's low latency, volume, storage and scale expectations.
- Participate in daily scrum meetings and sprint sessions to help influence architectural decisions.

hadoop-job-img

Software Engineer, Machine Learning

company-icon Facebook

   New York, NYC
   20th Mar, 2017
Job Description:

Responsibilities

  • Develop highly scalable classifiers and tools leveraging machine learning, data regression, and rules based models

  • Suggest, collect and synthesize requirements and create effective feature roadmap

  • Code deliverables in tandem with the engineering team

  • Adapt standard machine learning methods to best exploit modern parallel environments (e.g. distributed clusters, multicore SMP, and GPU)

hadoop-job-img

Data Platform Engineer

company-icon Quartet

   New York, NYC
   19th Mar, 2017
Job Description:

Responsibilities

  • Integration with external APIs and systems to create integrations to/from Quartet
  • Understanding the business objectives and goals and design services that couple business logic with reusable components for future expansion
  • Coordinating with our Application engineers and product manager to understand the use cases and product requirements for this data ingestion
  • Monitoring performance and advising any necessary infrastructure changes
hadoop-job-img

Data Engineer

company-icon Dailymotion

   New York, NYC
   15th Mar, 2017
Job Description:
  • Develop reusable tools for the management and manipulation of hundreds of terabytes of data
  • Build a user profiling system for ad profiling
  • Analyze and improve efficiency, scalability, and stability of data collection, storage, and retrieval processes
  • Interface with other teams to incorporate their innovations and vice versa
  • Work closely with data analysts to construct creative solutions for their analysis tasks
  • Optimize our infrastructure at both the software and hardware level
  • Ingest and store terabytes/ petabytes of data
 
hadoop-job-img

Data Engineer

company-icon Dailymotion

   New York, NYC
   15th Mar, 2017
Job Description:
  • Develop reusable tools for the management and manipulation of hundreds of terabytes of data
  • Build a user profiling system for ad profiling
  • Analyze and improve efficiency, scalability, and stability of data collection, storage, and retrieval processes
  • Interface with other teams to incorporate their innovations and vice versa
  • Work closely with data analysts to construct creative solutions for their analysis tasks
  • Optimize our infrastructure at both the software and hardware level
  • Ingest and store terabytes/ petabytes of data
 
hadoop-job-img

Big Data Developer

company-icon United Health Group

   Eden Prairie, MN
   14th Mar, 2017
Job Description:
  • Work with business stakeholders to understand requirements / business use cases
  • Design and develop dashboards / reports / data discovery workflows / analytics solution using big data analytics tools such as Splunk, AtScale, and Platfora & Tableau 
  • Develop data pipelines to consume data from Enterprise Data Lake (MapR Hadoop distribution - Hive tables/HDFS) for analytics solution
  • Perform functional and performance testing
  • Deploy big data solutions into production
  • Work with Infrastructure team in deploying solutions into production
  • Implement projects / use case in agile environment
  • Responsible for maintaining & monitoring data quality for Analytical dashboards / reports
  • Contribute to Knowledge repository by documenting technical design considerations, best practices, business workflows, project documentation, troubleshooting guide etc.
  • Provide business user support.  Troubleshoot production problems / functional issues with data visualization & discovery tools
  • Implement process improvements (Automation, Performance tuning, Optimize workflows)
  • Collaborate with business and IT partners such as Infrastructure team, Vendor team, internal teams and offshore team
  • Work with offshore team. 
  • Guide offs - shore team

 

hadoop-job-img

Jr. Systems Engineer - Big Data

company-icon TEKSystems Inc.

   US-CA-Glendale
   07th Mar, 2017
Job Description:
  • Experience within Linux systems administration
  • Troubleshooting Linux systems and maintaining performance
  • Experience maintaining and writing infrastructure as code
  • Experience improving process and workflow around application development
  • Troubleshooting network connection issues with web servers and databases
  • Checking server performance
  • Troubleshooting within AWS (EC2, RDS, VPC -networking experience)
  • Troubleshooting cloud environment within AWS
  • Experience supporting Big Data Infrastructure
  • Supporting building out a data lake within data insights and analytics
  • Collaborating with data engineers to support data insight projects
  • Experience developing tools and automation that support ETL jobs that feed into the data lake
  • Experience with Big Data tools such as Hadoop, Apache Spark and Apache Kafka
  • Experience with Hashicorp to provision, secure and run distributed application infrastructure
  • Experience supporting Java applications
  • Experience with build and automation tools for Continuous Integration and Continuous Delivery
  • Experience with Jenkins for CICD
  • Experience with Apache Maven build manager tool
  • Experience scripting within Jenkins using Groovy
  • Additional Scripting languages (Python, Bash, Ruby)
  • Experience using Jenkins for continuous delivery pipeline



 

hadoop-job-img

Hadoop Developer

company-icon The Oak Leaf Group

   Washington DC
   28th Feb, 2017
Job Description:
  • Manage data extraction jobs, but also play a vital role to build new data pipelines from various structured and unstructured sources into Hadoop.
  • Execute and/or support the test certification scripts, analyze the results to validate the results against established success criteria.
  • Support patching, incident and problem management activities.
  • Enable environment sustainability through technology training and development of user guides and knowledge artifacts.
  • Provide work guidance or technical assistance to less senior engineers.

 

hadoop-job-img

Big Data Hadoop Consultant

company-icon Accenture

   San Francisco, CA
   20th Feb, 2017
Job Description:
  • Deliver large-scale programs that integrate processes with technology to help clients achieve high performance.
  • Design, implement and deploy custom applications on Hadoop.
  • Implementation of complete Big Data solutions, including data acquisition, storage, transformation, and analysis.
  • Design, implement and deploy ETL to load data into Hadoop.
hadoop-job-img

Senior Big Data Developer

company-icon HCA Corporate

   Nashville, US
   18th Feb, 2017
Job Description:
  • Responsible for building and supporting a Hadoop-based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured data. 
  • Manage and optimize Hadoop/Spark clusters, which may include many large HBase instances
  • Support regular requests to move data from one cluster to another
  • Manage production support teams to make sure service levels are maintained and any interruption is resolved in a timely fashion
  • Bring new data sources into HDFS, transform and load to databases.
  • Work collaboratively with Data Scientists and business and IT leaders throughout the company to understand Big Data needs and use cases.    

 

hadoop-job-img

Sr. Hadoop Developer

company-icon HomeAway

   Austin, Texas
   17th Feb, 2017
Job Description:
  • Build infrastructure using Hadoop’s core components such as HBase, Kafka, and Hive.
  • Build data flows using Hadoop’s components including Oozie, Sqoop, Kafka and Hive
  • Build work flows to accomplish complex tasks such as predictive analytics.
  • Proficient with java and restful API development 
  • Collaborate with other teams including Software Developers, Data Scientist, and Data Warehouse Developers
  • Work with large, multi-terabyte, data sets data using Hadoop, Hive and SQL.Be proficient with MapReduce 
  • Be proficient with HBase
  • Have a solid understanding of Hadoop’s infrastructure.
  • Work in a collaborative environment

     
hadoop-job-img

Senior Big Data (Hadoop) Specialist

company-icon RBC

   Toronto, ON, CANADA
   09th Feb, 2017
Job Description:
  • Sets technical direction for all development, maintenance and application architecture initiatives ensuring adherence to overall IT architectural and solution direction.
  • Provides leadership on the construction and maintenance of robust and efficient applications and reusable frameworks.
  • Expert consultant on technical and management direction for strategic projects with a focus on the cross-divisional strategies.
  • Provides expert counseling to application development community
  • Researches emerging trends/best practices and determines implications of proposed solutions on meeting business unit strategy.
  • Develops feasibility studies and proposals for senior management and executive decisions on large complex projects.
  • Together with Project Manager, determines best mix of development, interfacing applications, third party vendor solutions to meet business requirements and project objectives.
  • Develops criteria to evaluate 3rd party vendors and software as well as due diligence exercises. (For very complex projects, conducts due diligence; for less complex projects oversees the process.)
  • Key contributor in the creation of technical strategy for applications within RBC IT with the architecture group.
  • Identifies technical and business opportunities to take advantage of cross project knowledge, best practices and reusability to expedite projects.
  • Leads complex group meetings (including business partners) for technical design, decision making, problem solving, implementation and strategic planning.

 

hadoop-job-img

Senior Hadoop Developer

company-icon Cypress HCM

   San Diego, California
   01st Feb, 2017
Job Description:
  • Design and develop end-to-end Hadoop data ingestion process.
  • Design and develop Hadoop data integration in both real-time and scheduled mode leveraging appropriate Hadoop open integration framework. Utilizing tools like: Storm, Flume, Sqoop, Oozie, etc.
  • Manage Hadoop clusters and guide the operational best practices for Hadoop cluster configuration.
  • Build Libraries, user defined functions and frameworks around Hadoop
  • Manage the performance and allocations in open distributed file system (HDFS) leveraging Hadoop
  • Implement standards based monitoring and tuning practices for the 20+ nodes Hadoop ecosystem.
  • Translate requirements from business & engineering teams to Hadoop technology solutions.
hadoop-job-img

Big Data Developer

company-icon Fannie Mae

   Herndon, VA
   31st Jan, 2017
Job Description:
  • Participate with team of technical staff and business managers or practitioners in the business unit to determine systems requirements and functionalities needed in large/complex development project.
  • Assess and develop high level design requirements for project and communicate in writing or in meetings with development team. Assess detailed specifications against design requirements.
  • Review coding done to advance application upgrade, extension, or other development. Analyze application for data integrity issues.
  • Develop test protocols or plan for testing revised application and review test results.
  • Serve as project lead or lead technical staff in course of application development project
  • May mentor less experienced technical staff; may use high end development tools to assist or facilitate development process.

 

hadoop-job-img

Hadoop Solutions Architect

company-icon Scotiabank

   Toronto, ON, Canada
   27th Jan, 2017
Job Description:


• Act as the Subject Matter Expert and holds overall accountability for the technical delivery and implementation of projects involving complex integrations regardless of purchased, built, or hybrid solutions.
• Develop solution, technology and infrastructure roadmaps, including options that are mapped to technology roadmaps.
• Demonstrate strong leadership, and being able to lead multi-million projects
• Work together with infrastructure and enterprise architects.
• Work with some predefined standards and with unknowns.
• Being able to work under pressure and is a goal getter.
• Participate in the Architecture forum.
• Research and recommend enhancements to the strategic technology evolution of the organization based on new and emerging technologies.
• Translate highly complex concepts for peers and customers.
• May participate in the full systems life cycle for designing, coding, implementing and supporting applications software.

 

hadoop-job-img

Java / Big Data Developer

company-icon JPMorgan Chase & Co.

   New Jersey
   24th Jan, 2017
Job Description:

Responsibilities 

  • Component Software Design & Development.
  • Ensuring excellent practices are utilized in delivering Big Data Management and Integration Solutions.
  • Ensuring design decisions can be actioned by the development team.
  • Participating in agile development projects.
  • Acting as a role model for all best practices, ensuring consistency across entire team.
  • Mentoring technical development team on optimal utilization of Big Data solutions and Apache Open Source Software.
  • Helping build a great team.
  • Leveraging new and emerging practices for Enterprise Data Architecture.
  • Engage in enterprise-level systems component design and implementation.
  • Systems integration, including design and development of APIs, Adapters, and Connectors.
  • Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions.
  • Write and maintain reference architectures and systems design ‘best practices’ guidelines.

 

hadoop-job-img

Hadoop Developer

company-icon Bank of America

   Plano, Texas
   24th Jan, 2017
Job Description:
  • Have a good understanding of the E2E process of the application
  • Work with the Business Analysts to understand the enhancements / changes being propagated in a particular release cycle, design and work on the coding & unit testing tasks
  • Work with the QA team during the SIT phase and support the SIT
  • Work with Platform Support team during UAT phase
  • Identify improvement areas within the application and work with the respective component teams to implement the same
  • Be a good team player
  • Flexibility in adapting to team requirements
  • Ensuring adherence to defined process & quality standards, best practices
  • Ensuring high quality levels in all deliverables
  • Adhere to teams governing principles and policies
  • Participate in mandatory training and cross functions across team
  • Demonstrate enthusiasm and zeal to acquire domain knowledge
  • Participate and contribute to Team/Project Reviews
  • Actively involved in Process improvements and automations.
hadoop-job-img

Hadoop Architect

company-icon Booz Allen Hamilton

   McLean, VA
   11th Jan, 2017
Job Description:
  • Assist with building a robust and service-oriented common services platform.
  • Build the platform using cutting-edge capabilities and emerging technologies, including Data Lake and Hortonworks data platforms that will be used by thousands of users.
  • Work in a Scrum-based agile team environment using Hadoop. Install and configure the Hadoop and HDFS environment using the Hortonworks data platform.
  • Create ETL and data ingest jobs using Map Reduce, Pig, or Hive. Work with and integrate multiple types of data, including unstructured, structured, and streaming.
  • Use Lucene-powered tools to implement a search service for all data sets.
     
hadoop-job-img

Hadoop Engineer

company-icon SpotX

   Westminster,Colorado
   09th Jan, 2017
Job Description:
  • Loading disparate data sets and performing analysis of vast data stores
  • Testing prototypes and propose best practices for Big Data
  • Developing new tools and technologies in the video ad serving space
  • Be a part of a scrum team comprised of 4 to 5 developers
  • Participate in daily standup meetings and all meetings of the agile SDLC: planning, estimation, retrospectives, demos, etc.

 

hadoop-job-img

Foundational Services – Data Services Software Engineer

company-icon Bloomberg

   New York, NYC
   06th Jan, 2017
Job Description:

Responsibilities :

  • Design, implement and own critical applications and components of our services stack
  •  Participate in the full SDLC (Software Development Life Cycle) of various components and systems that are required to be highly efficient, robust and scalable
  •  Enhance our infrastructure to fulfill mission critical SLAs, whether low latency or high throughput data retrieval
  •  Get to know development teams across Bloomberg, understand their application requirements and data access patterns
hadoop-job-img

Senior Hadoop Engineer

company-icon Conversant

   San Francisco, CA
   05th Jan, 2017
Job Description:

Responsibilities

  • Provide tuning support and analysis for client applications
  • Provide framework support for client teams with Spark, HBase, Hive
  • Drive best practices for developing application against Hadoop Clusters
  • Provide application tuning for Spark applications.

 

hadoop-job-img

Hadoop Application Developer

company-icon Apple

   Santa Clara Valley, California,USA
   29th Dec, 2016
Job Description:

Key Responsibilities include:

  • Hands-on Hadoop developer will be responsible for the translation of user requirements and system objectives into logical, efficient, and practical workflow designs and Programs.
  • This person will be preparing detailed datafile, schema, and program specifications from which new systems will be developed and/or existing systems modified.
  • The ability to work independently toward the completion of project milestones.
  • Developing detailed specifications for the creation of new or modified programs, including the recommendation of logical designs, record/report layouts, and screen designs.
  • Designing program logic to perform business requirements efficiently and reliably.
  • Developing and executing unit and systems test plans that will thoroughly exercise system integration.
  • Performing business and BI requirement analysis, lead design and develop logical data models by translating business needs into technical solutions.
  • Act as a technical resource for others within the group.
hadoop-job-img

Hadoop Developer

company-icon Capgemini

   New York, NYC
   29th Dec, 2016
Job Description:

Responsibilities:

  • Hands-on developer in one of the following key areas: a. Work as a
    Sr Developer on the CCAR data sourcing initiative b. Ingestion of trade and
    position, reference data into Hadoop from a variety of legacy data stores
    including Oracle , SQL server to HDFS big data platform c. Transformation of
    data into one or more analytical representations d. Publication of data to a
    number of downstream consumers
  • Full size data migration and define data retention
  • Participate in the management of our production and test
    environments by completing critical works that arise on support.
  • Reducing technical debt through the suggestion and implementation
    of strategic platform improvements
  • Support external teams that expect to consume data through
    training on Hadoop technologies, development of POCs, and assistance with
    technical questions Skill.

 

hadoop-job-img

Big Data Engineer

company-icon Quicken Loans

   Detroit, MI
   15th Dec, 2016
Job Description:

The Data Warehouse Engineer for Big Data (DWE) is responsible for the full life cycle of the back-end development of a Hadoop data warehouse. Responsibilities include developing ETL processes, designing structured data models from unstructured datasets, and integrating data in Hadoop with an SQL Server data warehousing environment. Projects range from bringing in structured, semi-structured, and unstructured data to provide analytics and new insights that allow the business to make data-driven decisions. The DWE works closely with Business Analysts to work through business requirements and develop processes necessary to provide visibility into the data that is stored in Hadoop. The DWE helps ensure that Hadoop and MapReduce jobs are running optimally.

Responsibilities

  • Develop ETL processes to populate a Hadoop data warehouse with large datasets from a variety of sources, and integrate Hadoop within an SQL Server data warehousing environment
  • Create MapReduce programs in Java or Python, and leverage tools like Pig and Hive to transform and query large datasets
  • Assist with Hadoop administration to ensure the health and reliability of the cluster
  • Monitor and troubleshoot performance issues on a Hadoop cluster
  • Follow the design principles and best practices defined by the team for data warehousing techniques and architecture
hadoop-job-img

Big Data Hadoop Developer

company-icon United Health Group

   Cypress, CA
   15th Dec, 2016
Job Description:

Primary Responsibilities: 

  • Design, implement and maintain .Net application within all phases of the Software Development Life Cycle (SDLC)
  • Develop, test, implement and maintain application software working with established processes
  • Communicate effectively with other engineers and QA
  • Establish, refine and integrate development and test environment tools and software as needed
  • Identify production and non-production application issues
  • Identify opportunities to fine-tune and optimize applications of .Net developed projects
  • Provide technical support and consultation for .Net application and infrastructure questions
  • Serve as a mentor to less experienced Developers
  • Primary contributor in designing, coding, testing, debugging, documenting and supporting all types of applications consistent with established specifications and business requirements to deliver business value. Identify and design most efficient and cost effective solution through research and evaluation of alternatives
  • Participate in Design reviews, Test Case reviews, and Production Support readiness reviews for new releases, provide inputs for Go/No Go decision
  • Provides team leadership in areas of specific technical knowledge that is frequently sought out by others with significant experience in a single, complex development environment or across multiple platforms
  • Assist Service Manager and Service Director in providing management status reports on daily, weekly and monthly basis
  • Ensure that all documentation has been updated and that work product meets UDP / SOX compliance requirements
  • Conduct or facilitate root cause analysis on all in-scope incidents and recommend a corrective action plan
  • Assist in Providing estimates on break/fix, and problem-management activities
  • Identify application performance improvement initiatives and implement the same in consultation with the Service Manager
  • Independent communication with business partners to resolve issues and negotiate project related items such as priorities and completion deadlines
  • Document suggestions for continuous process improvements for both OM and development activities
  • Provide timely updates on tasks to reporting supervisor
  • Adherence to the defined delivery process/guidelines (SLA Compliance etc)
  • Adherence to the defined OM delivery process/guidelines (SLA Compliance etc)

 

hadoop-job-img

Hadoop Developer CGI-experience the commitment

company-icon CGI

   Bloomfield, Connecticut, United States
   14th Dec, 2016
Job Description:

CGI has an immediate need for a Hadoop Developer in Bloomfield, CT. If you have been working in the healthcare industry, this is the chance to further advance your career.

Your future duties and responsibilities:

Must Have: Java/JavaScript, Automation Skills and Agile Working Experience.

Must Have: Strong Hadoop Architecture knowledge.

Expert in HIVE SQL and ANSI SQL - Great hands on in Data Analysis using SQL. 

Ability to write simple to complicated SQL in addition to having ability to comprehend and

Support data questions/analysis using already written existing complicated queries.

hadoop-job-img

Hadoop Data Engineer

company-icon VISA

   Palo Alto, California, United States
   14th Dec, 2016
Job Description:

Responsibilities

  • Work with data team to efficiently use hadoop infrastructure to analyze data, build models, and generate reports/visualizations
  • Create and optimized distributed algorithms to scale out recommendation engine
  • Integrate massive datasets from multiple data sources for data modeling
  • Implement methods for automation of all parts of the predictive pipeline to minimize labor in development and production
  • Formulate business problems as technical data problems while ensuring key business drivers are captured in collaboration with product management
  • Knowledge in machine learning algorithms especially in recommender systems

 

hadoop-job-img

Cloudera Hadoop Developer

company-icon Adept Solutions

   Wilmington, Delaware
   10th Dec, 2016
Job Description:
  • Candidates who are authorized to work in the US without any company endorsements.
  • Seeking a Cloudera Hadoop Developer// Architect.
  • Candidates will assist with data architecture, migration, and development of new processes flows on the Cloudera stack.
  • Candidates must have a strong background with the Netezza architecture.
  • The candidate will be leading Analytics engagements for Life Sciences clients onsite in Wilmington, Delaware.
hadoop-job-img

Big Data Engineer

company-icon MachineZone

   PALO ALTO, CA
   08th Dec, 2016
Job Description:

RESPONSIBILITIES:

  • Use streaming and batch technologies to build a analytic pipeline at scale
  • Design and develop with latest big data technologies
  • Process and analyze large datasets
  • Find, troubleshoot and resolve problems.
hadoop-job-img

Big Data Engineer

company-icon Machine Zone, Inc.

   Palo Alto, CA
   08th Dec, 2016
Job Description:
  • Use streaming and batch technologies to build a analytic pipeline at scale
  • Design and develop with latest big data technologies
  • Process and analyze large datasets
  • Find, troubleshoot and resolve problems.
hadoop-job-img

Hadoop/Spark Full Stack Developer

company-icon JPMorgan Chase & Co.

   NEW YORK, NY
   07th Dec, 2016
Job Description:
  • Build and implement front-end web applications and back-end services that integrate with other products.
  • Interact with clients both within JPMIS and across the firm (including counterparts in Retail & Wholesale Banking, Risk, Digital/Mobile)

  • Validate requirements and system design

  • Automate and streamline existing processes, procedures, and toolsets

  • Ensure code paths are unit tested and defect free

  • Participate in full integration testing

  • Rapidly address issues and fix defects discovered during deployment

hadoop-job-img

Senior Hadoop Engineer

company-icon Publishers Clearing House

   Port Washington, NY
   24th Nov, 2016
Job Description:
  • 4+ years of solution architecture in Hadoop
  • Strong ability to drive complex technical solutions deployed at an enterprise level; ability to drive big data technology adoption and changes through education and partnership with stakeholders
  • Ability to negotiate, resolve, and prioritize complex issues and provide explanations and information to others on difficult issues
  • Estimate and organize own work to meet or negotiate deadlines - lead / facilitate the creation of estimates
  • Self-starter who can work with minimal guidance
  • Strong communication skills
hadoop-job-img

Big Data Software Engineer

company-icon Sila

   Arlington, Virginia
   24th Nov, 2016
Job Description:
  • Design, develop, and implement Hadoop-based big data solutions
  • Work directly with clients to achieve their business goals
  • Research, evaluate, and deploy new tools, frameworks and patterns to build sustainable Big Data platforms for our clients
  • Identify gaps and opportunities for improvement of existing solutions
  • Define and develop APIs for integration with various data sources in the enterprise
  • Be an active hands-on team member, collaborating with other developers and architects in developing client solutions
hadoop-job-img

Hadoop Developer

company-icon Title Source, Inc.

   Detroit,MI
   21st Nov, 2016
Job Description:

Responsibilities

  • Design, build, install, configure, and support the Hadoop environment
  • Translate complex functional and technical requirements into detailed design
  • Perform analysis of vast data stores to uncover insights
  • Create scalable and high-performance web services for data tracking
  • Work with developers to evaluate Hadoop use cases, provide feedback, and design guidance
  • Work simultaneously on multiple projects and prioritize accordingly
  • Be part of the on-call rotation for your area(s) of responsibility and expertise
hadoop-job-img

Big Data Applications Developer

company-icon JPMorgan Chase & Co.

   Jersey City, NJ
   19th Nov, 2016
Job Description:
  • Taking part in project planning sessions with project leads, business users and team members to analyze business requirements and outline the proposed IT solution. 
  • Participate in standard SDLC process using Agile methodology and test driven approach. 
  • Adhere to IT Control Policies through design, development and testing and incorporate Corporate Architectural Standards into application design specifications. 
  • Documentation of deliverables. 
  • Participate in code reviews and ensure that all solutions are aligned to pre-defined architectural specifications; identify/troubleshoot application code-related issues; and review and provide feedback to the final user documentation.
hadoop-job-img

Senior Application Developer

company-icon Verizon

   Temple Terrace, FL
   18th Nov, 2016
Job Description:

Join our Information Technology team where you will work on new technologies and find ways to meet our customers’ needs and make it easy for them to do business with us. You will manage a team to resolve a diverse range of complex problems and regularly lead multiple, technically complex, large-scale projects.

  • Regularly lead multiple medium to large-scale projects and guide staff members & peers using DevOp, Mobile and Java technologies
  • Develop resolutions to complex problems creatively and make decisions that impact projects and end clients.
  • Exercise considerable judgment in developing methods, techniques and evaluation criteria for obtaining results.
  • Responsible for creating and managing data repository for customer need/capability/analytics using Big data echo system
  • Design and build advanced applications around mobile eco system on Android OS/ Web Architecture.

 

hadoop-job-img

BigData / Hadoop Developer

company-icon InfiCare Technologies

   Madison, WI
   17th Nov, 2016
Job Description:
  • Experience with Hadoop (HDinsight). [Mandatory]
  • Experience with Map-Reduce, Zookeeper, HDFS, Pig, Sqoop and Hive. [Mandatory]
  • Experience monitoring Hadoop cluster performance . [Preferred]
  • Experience with programming language like Python or C#. [Preferred]
  • Experience with Azure cloud services. [Mandatory]
  • Knowledge of Linux system monitoring and analysis. [Preferred]
  • Understanding of ETL principles and how to apply them within Hadoop. [Preferred]
  • Experience with scheduling tools like Control-M and Oozie. [Mandatory]
  • Knowledge of Spark and understanding of DAGs a plus. [Preferred]
hadoop-job-img

Hadoop Developer

company-icon Levi, Ray and Shoup, Inc.

   Broomfield, CO
   14th Nov, 2016
Job Description:

The Hadoop Developer will:

- Perform Hadoop development and implementation.

- Load disparate data sets and perform analysis of vast data stores.

- Test prototypes and propose best practices for Big Data.

- Develop new tools and technologies in the video ad serving space.

- Be a part of a scrum team comprised of 4 to 5 developers.

- Participate in daily standup meetings and all meetings of the agile SDLC: planning, estimation, retrospectives, demos, etc.
 

hadoop-job-img

Senior Site Reliability Engineer

company-icon Marin Software

   San Francisco, CA
   11th Nov, 2016
Job Description:
  • Write deployment automation using Ansible
  • Perform software deployments to pre-production and production environments
  • Collaborate with development on the planning and deployment of services
  • Create monitoring tools and manage monitoring systems
  • Provision new virtual and physical hardware
  • Troubleshoot infrastructure and services issues, including working with vendors.
  • Participate in a rotating on-call schedule
  • Write documentation as required
hadoop-job-img

Big Data (Hadoop) Solution Architect

company-icon Amazon.com

   New York, NY
   10th Nov, 2016
Job Description:
  • Work with customers to deploy cutting-edge solutions that leverage Amazon EMR
  • Develop technical content, such as white papers and reference architectures, that can be used by our customers to assist them in deploying cloud-based analytic solutions
  • Capture and share best-practice knowledge amongst the AWS solutions architect community
  • Assess EMR-related knowledge across AWS sales, solutions architecture and business development teams and develop plans to address gaps
  • Evangelize Amazon EMR technologies to big data community
  • Build and maintain technical trusted advisor relationships to influence key technical decision makers on platform choices
  • Represent AWS at trade events by delivering presentations and lectures
  • Partner with the EMR service team to channel voice-of-the-customer on emerging trends and requirements to materially shape the roadmap
hadoop-job-img

Hadoop Big Data Engineer

company-icon Comcast

   New York, NY
   09th Nov, 2016
Job Description:

- Design and build data processing pipelines for structured and unstructured data using tools and frameworks in the Hadoop ecosystem
- Architect and develop applications that scale up to a Billion events per day
- Build streaming and real-time data analytic pipelines
- Implement and configure big data technologies as well as tune processes for performance at scale

hadoop-job-img

Senior Analyst

company-icon Acxiom

   New York, NY
   05th Nov, 2016
Job Description:

Analyst role requires extensive analytical, data product and business skills applied through the execution of data including, development, and creation of data content for use in data products and solutions. Analysts are responsible for data analysis, reporting, and technology implementations using industry leading principles, methodologies, and programs. These analytic activities are typically product or solution based designed for use by many clients or the focus of a single client who requires custom research and data development to solve a specific business problem. The Senior Analyst develops technical plans and business plans for new development efforts. Defines project requirements including data sources, statistical methods, and implementation. The Analyst is a thought leader who is innovative and logical and aware of current privacy/compliance laws and one who has the ability to participate and contribute to all facets of the data life cycle either independently or as part of a team.

hadoop-job-img

Senior Software Engineer

company-icon Conductor

   New York, NY
   04th Nov, 2016
Job Description:
  • Working with a scrum team developing new functionality for our customers
  • Designing and evolving core data access and analysis components
  • Evaluating and applying new technologies and methodologies to stay ahead of the market
  • Promoting best practices and mentoring other engineers on server side development
hadoop-job-img

Data Analytics and Data Services Developer

company-icon CitiMortgage

   Long Island City, NY
   03rd Nov, 2016
Job Description:
  • Technical Design & development of Operations Dashboard and Data Quality Engine
  • Technical Design & Implementation of Portfolio analytics and calculation services
  • Develop solution to evaluate and demonstrate investment performance based on single account, portfolio hierarchy, client level, or client grouping levels
  • Design, Develop & Integrate Data Quality rules engine with overall data platform & ETL tools
  • Ensure platform delivery, stability, simplify environment & integration with strategic roadmap
  • Must be comfortable working in a dynamic, fast paced and high pressure environment through development life cycle across both onshore and offshore locations
  • Participate in the application development life cycle and drive engineering excellence
  • Understanding and delivering solutions in line with Client Reporting strategy
  • Manage development environment to ensure stability, simplify environment & deliver strategic solutions
  • Manage and own problem reporting & resolution
  • Collaborate and partner closely with program managers, BAs, development leads, testing leads and production support teams to ensure delivery meets highest quality standards
hadoop-job-img

Hadoop Developer

company-icon Sonsoft Inc

   Jersey City, NJ
   28th Oct, 2016
Job Description:

• Strong hands on experience with Java, web-services and APIs
• Strong knowledge and hands-on programming experience in Hadoop ecosystem
• Experience in Data ingestion (Batch and Real time) , Data Encryption, Reconciliation
• Strong understanding and hands-on programming/scripting experience skills preferably Python, Perl, Javascript, UNIX shell
• Should have worked on large data sets and experience with performance tuning and troubleshooting
• Experience in all the life cycle phases of the project
• Should be a strong communicator and be able to work independently with minimum involvement from client SMEs
• Should be able to work in team in diverse/ multiple stakeholder environment


Preferred
• Experience in NoSQL Databases is preferred
• Experience to Financial domain is preferred
• Experience and desire to work in a Global delivery environment
The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements.

hadoop-job-img

Hadoop Developer

company-icon Capgemini

   New York, NY
   27th Oct, 2016
Job Description:
  • Design and Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.
  • Collaborate with other teams to design and develop data tools that support both operations and product use cases.
  • Source huge volume of data from diversified data platforms into Hadoop platform
  • Perform offline analysis of large data sets using components from the Hadoop ecosystem.
  • Evaluate big data technologies and prototype solutions to improve our data processing architecture.
  • Knowledge of Private Banking & Wealth Management domain is an added advantage
hadoop-job-img

Hadoop Developer

company-icon HCSC

   San Jose, CA
   26th Oct, 2016
Job Description:

This position is responsible for developing, integrating, testing, and maintaining existing and new applications; knowing one or more programming languages; knowing one or more development methodologies / delivery models.

hadoop-job-img

Big Data Engineer/Hadoop Developer

company-icon Teknetex, Inc.

   Roles Inn of America, AZ
   25th Oct, 2016
Job Description:

• Participate as a member of a small team to release the full potential of Big Data through a combination of platform technology, collective human intelligence and the vast data resources available to our company
• Provide rich insight into consumer behaviors, preferences and experiences in order to improve the customer experience across a broad range of vertical market
• Development of high performance, distributed computing tasks using Big Data technologies such as Hadoop, NoSQL, text mining and other distributed environment technologies based on the needs of the Big Data organization
• Use Big Data programming languages and technology, write code, complete programming and documentation, and perform testing and debugging of various applications
• Analyze, design, program, debug and modify software enhancements and/or new products used in distributed, large scale analytics solutions
• Interacts with data scientists and industry experts to understand how data needs to be converted, loaded and presented
• Provide rich insight into consumer behaviors, preferences and experiences in order to improve the customer experience across a broad range of vertical market

hadoop-job-img

Senior Developer

company-icon Huxley Associates

   New York, NY
   22nd Oct, 2016
Job Description:

We are looking for someone who can provide life cycle services on Big data Platforms, Provide Guidance and principles on best practices to be followed.

This person is also going to manage the centred workload, community, and would be responsible for staffing and training new team members. 

hadoop-job-img

SR Software Engineer

company-icon CDK

   Portland, OR
   21st Oct, 2016
Job Description:

As a Software Development Engineer IV you will help to create the next generation of enterprise class software solutions at CDK utilizing a broad range of the latest technologies. You will join our Call Intelligence team as an experienced full-stack developer.

hadoop-job-img

Data Engineer

company-icon Evernote

   San Francisco, CA
   19th Oct, 2016
Job Description:
  • Design, build and maintain efficient and reliable real-time data pipelines to move data across systems
  • Architect, implement and improve a machine learning platform designed for feature engineering, model building, training, and validation
  • Implement a data workflow platform that let users aggregate and structure data for high-performance analytics
  • Collaborate with multiple teams in high visibility roles to implement new data workflows and own the solution end-to-end
  • Design and develop new systems and tools in a number of languages to facilitate effective data consumption
  • Evaluate, benchmark and integrate cutting edge open source data tools and technologies
  • Monitor performance of the data platform and optimize as needed
hadoop-job-img

Senior Data Engineer

company-icon Instacart

   San Francisco, CA
   18th Oct, 2016
Job Description:

The ideal candidate is able to build and maintain a robust, scalable and sustainable enterprise data platform. Furthermore, s/he is well-versed in the best practices of data warehousing, but is flexible enough to think outside the box whenever necessary. The Data Engineer should be no stranger to high-scale systems with complex data models and large amounts data coming from various sources.

  • Work closely with the analysts and business stakeholders to gather technical requirements
  • Provide senior-level contribution to a team responsible for the design, implementation, deployment and maintenance of a multi-terabyte data platform
  • Contribute the continual improvement of the Instacart data platform via your observations and knowledge gained from your involvement and KPI's
  • Work in a collaborative environment -- meetings, iterative development and design and code review sessions
hadoop-job-img

Software Engineer / DevOps Engineer

company-icon Digital Reasoning

   New York, NY
   17th Oct, 2016
Job Description:
  • You will be working onsite with our customer to provide ongoing custom software development and operational management of our platform. This role will require working in a Linux environment, interfacing with Cloudera’s Hadoop distribution (CDH), Elasticsearch search and indexing framework, and our Synthesys platform, along with its various services and components.
  • Not only will you oversee the management of our platform, you will also be spearheading solution development for new use cases, helping our client understand how our platform works, and how they might be able to take advantage of it to solve new problems in their organization. In addition, you will be a key participant in ongoing capacity planning, workflow expansion and integration, new Key Indicator development, and analytical model training.
  • You will primarily be based at our customer’s location in New York (midtown Manhattan) supporting these efforts. Occasional travel may be required, though it will be limited to at most two or three weeks a year.
hadoop-job-img

Senior Hadoop Developer

company-icon Bloomberg

   New York, NY
   15th Oct, 2016
Job Description:
  • Take ownership of a component of the BQL, Price History or BDP platform
  • Interact with development teams across Bloomberg and understand their application requirements and access patterns
  • Design and develop systems that meet our latency, volume, storage and scale expectations
  • Participate in daily scrums to help influence architectural decisions
hadoop-job-img

Sr. Developer

company-icon RBC

   Jersey City, NJ, US
   13th Oct, 2016
Job Description:

-Implementation of information and data quality management processes, data stewardship, enterprise metadata management and related programs
- Able to write Java programs that solve business needs. Work with other architects to maintain overall technology portfolio with supporting standards and guidelines 
- Work closely with application development teams to address issues relating to application architecture, such as performance or availability, and recommend solutions
- Perform product analysis and development tasks of increasingly complex nature which may require extensive research and analysis
- Work independently in the development, testing, implementation and maintenance of complex systems with fast turn-around
- Provide detailed analysis of problems; prepare detailed design documents with recommendations
- Apply innovation, creativity and improvement to development process and implement process and procedural improvements
- Assist in defining technology strategy, application architecture and prioritizations for large programs

hadoop-job-img

Lead/Sr. Engineer, Platform

company-icon Catalina Marking Saint Petersburg

   San Jose, CA
   07th Oct, 2016
Job Description:
  • passion for building software and delivering technology for business. If you are looking for an average 9 to 5 job, this might not be the one for you.
  • Commitment to quality over quantity. When consumers are your end-user, you can’t afford to launch with issues.
  • A desire to collaborate, more often than not. You won’t spend much time in isolation here at Catalina.
  • An ability to create streamlined applications that perform under load. Our systems have less than a second to respond or revenue is lost.
  • A good working knowledge of Agile software engineering processes. Bonus points if you have helped another organization make the transition.
  • Clear communication skills. We are looking for someone that is comfortable talking to peers about a design solution on the same day they are explaining a new technology to an executive.
  • A desire to focus on results, less on non-value activities. As a lean IT professional on the team, you’ll have goals to meet, and the freedom to meet those goals in the most effective manner possible.
hadoop-job-img

Big Data Archietect-Hadoop/Java

company-icon ADS Services

   El Segundo, CA
   06th Oct, 2016
Job Description:
  • Hadoop development and implementation.
  • Loading from disparate data sets.
  • Pre-processing using Hive and Pig.
  • Designing, building, installing, configuring and supporting Hadoop.
  • Translate complex functional and technical requirements into detailed design.
  • Perform analysis of vast data stores and uncover insights.
  • Maintain security and data privacy.
  • Create scalable and high-performance web services for data tracking.
  • High-speed querying.
  • Managing and deploying HBase.
  • Being a part of a POC effort to help build new Hadoop clusters.
  • Test prototypes and oversee handover to operational teams.
hadoop-job-img

Big Data Archietect-Hadoop/Java

company-icon ADS Services

   El Segundo, CA
   06th Oct, 2016
Job Description:
  • Hadoop development and implementation.
  • Loading from disparate data sets.
  • Pre-processing using Hive and Pig.
  • Designing, building, installing, configuring and supporting Hadoop.
  • Translate complex functional and technical requirements into detailed design.
  • Perform analysis of vast data stores and uncover insights.
  • Maintain security and data privacy.
  • Create scalable and high-performance web services for data tracking.
  • High-speed querying.
  • Managing and deploying HBase.
  • Being a part of a POC effort to help build new Hadoop clusters.
  • Test prototypes and oversee handover to operational teams.
hadoop-job-img

Hadoop Developer

company-icon Sonsoft Inc

   San Francisco, CA
   04th Oct, 2016
Job Description:
  • Responsible for data Ingestion, data quality, development, production code management and testing/deployment strategy in BigData development (Hadoop).
  • Acts as a lead in identification and troubleshooting processing issues impacting timely availability of data in the BigData or delivery of critical reporting within established SLAs. Provide mentoring to Level 2 production support team.
  • Identifies and recommends technical improvements in production application solutions or operational processes in support of BigData platform and information delivery assets (ie, data quality, performance, supporting Data scientists etc.)
  • Focuses on the overall stability and availability of the BigData platform and the associated interfaces and transport protocols.
  • Researches, manages and coordinates resolution of complex issues through root cause analysis as appropriate
  • Establishes and maintains productive relationships with technical leads of key operational sources systems providing data to BigData plaform.
  • Establishes and maintains productive relationships with technical leads of key infrastructure support areas, such as system/Infra engineers.
  • Participate in daily standup meetings.
  • Ensure adherence to established problem / incident management, change management and other internal IT processes
  • Responsible for communication related to any day to day issues and problem resolutions. Communication may include direct department management as well downstream/upstream application contacts and business partners.
  • Ensures comprehensive knowledge transition from development teams on new or modified applications moving to ongoing production support.
  • Seeks improvement opportunities in design, solution implementation approaches in partnership with development team for ensuring the performance and health of the BigData platform.
  • Ensures timely and accurate escalation of issues to management

 

hadoop-job-img

Hadoop Spark Developer

company-icon DTS

   New York, NY
   01st Oct, 2016
Job Description:
  • Provides design and development support for Prime Margin Platform including
  • Analyze complex requirements and translates to technical design and specifications
  • Design, development, test, and implement application code
  • Follow all software development life cycle processes and standards
  • Participate in design and code reviews
  • Develops new documentation, departmental technical procedures and user guides
  • Follow change and incident management processes
  • Develop and foster a positive relationship with team members, team leads and business partners
  • Propose creative solutions to meet technical and business priorities
hadoop-job-img

Sr. Data Architect

company-icon Five9

   San Ramon, CA
   30th Sep, 2016
Job Description:
  • Design and develop a data platform that fits the transactional and reporting needs of the Organization.
  • Understand and analyze business data requirements and architect an accurate, extensible, flexible and logical data model.
  • Rapidly prototype and prove the solutions using relational and OLAP databases.
  • Understand and maintain existing schema with industry standard change management process to achieve zero down time schema upgrade.
  • Set up the data modelling tenants and review the proposed data modelling changes against the same.
  • Develop and keep current, a high-level data strategy that fits with the Data Warehouse Standards and the overall strategy of the Company.
  • Design and build world class high-volume real-time data ingestion frameworks and automate various data sources into Bigdata technologies like Hadoop etc.
  • Identify and predict technology needs related to data and reporting for the organization, and propose technology solutions.
  • Ability to identify and resolve any performance and/or data related issues in production.
  • Communicate and collaborate effectively and work closely within a coordinated team environment and maintain composure while dealing with time sensitive deadlines or challenging people.
hadoop-job-img

Java / Hadoop Developer

company-icon J.P. Morgan

   Brooklyn, NY
   29th Sep, 2016
Job Description:

 

  • Work on design, development of complex applications using various programming languages and technologies

  • Design and develop framework components

  • Responsible for delivering solution design and POC where applicable

  • Follow industry and JPMC standards and trends

  • Monitor implementations to help ensure adherence to established standards

  • Able to work on various technologies such as JAVA, Python, BigData etc

  • Ability to learn new and cutting edge technologies.

  • Ability to transform abstract design to concrete implementation

  • Interface with Business users for defining requirements and streamlining design

hadoop-job-img

Hadoop Developer

company-icon HCSC

   New York, NY
   28th Sep, 2016
Job Description:

This position is responsible for developing, integrating, testing, and maintaining existing and new applications; knowing one or more programming languages; knowing one or more development methodologies / delivery models.

hadoop-job-img

Big Data Engineer/Hadoop Developer

company-icon Teknetex, Inc.

   Roles Inn of America, AZ
   27th Sep, 2016
Job Description:

• Participate as a member of a small team to release the full potential of Big Data through a combination of platform technology, collective human intelligence and the vast data resources available to our company
• Provide rich insight into consumer behaviors, preferences and experiences in order to improve the customer experience across a broad range of vertical market
• Development of high performance, distributed computing tasks using Big Data technologies such as Hadoop, NoSQL, text mining and other distributed environment technologies based on the needs of the Big Data organization
• Use Big Data programming languages and technology, write code, complete programming and documentation, and perform testing and debugging of various applications
• Analyze, design, program, debug and modify software enhancements and/or new products used in distributed, large scale analytics solutions
• Interacts with data scientists and industry experts to understand how data needs to be converted, loaded and presented
• Provide rich insight into consumer behaviors, preferences and experiences in order to improve the customer experience across a broad range of vertical market

hadoop-job-img

Big Data DevOps Engineer

company-icon Tinder

   West Hollywood, CA
   23rd Sep, 2016
Job Description:

In this Big Data DevOps Engineer role, you will:

* Build and scale the data infrastructure for a global user base of 100s of millions.

* Have an essential role in developing and implementing data pipelines and machine learning train/test/use jobs

* Create tools to manage data pipelines and R&D projects

* Perform advanced troubleshooting and monitoring of the systems to ensure SLAs are met

* Deploy code as needed

* Work with our amazing data team

hadoop-job-img

Hadoop Lead Developer

company-icon Cognizant Technology Solutions

   Phoenix, AZ
   22nd Sep, 2016
Job Description:
  • Gathering requirements, analysis of entire system and providing estimation on development, testing efforts.
  • Coordinating with team to assign tasks and monitor team deliverables to meet project time lines.
  • Writing UNIX shell scripts to load the data from different interfaces to Hadoop.
  • Writing Sqoop scripts to import, export and update the data to RDBMS.
  • Strong object-oriented design and analysis skills
  • Excellent technical and organizational skills
  • Excellent written and verbal communication skills
hadoop-job-img

Hadoop Developer

company-icon Canvas InfoTech Inc.

   Palo Alto, CA
   21st Sep, 2016
Job Description:

· Define the basic architecture and structure of the system to meet the requirements.

· Developed custom input formats and user defined data types for the map reduce program to parse the zipped jsons.

· Deployment and Testing of the system in Hadoop MapR Cluster

· Pulling data set from OracleDB to HDFS

· Developing the Hadoop/Hbase Utilities to generate custom input/out from given data set

· Developing web service request to analyze the genuineness of cartridges in big data environment.

· Document and build unit test cases for the code

hadoop-job-img

Big Data Developer

company-icon Caliber Business Systems

   Jersey City, NJ
   20th Sep, 2016
Job Description:
  • This role will provide deep technical expertise in all aspects of application development for specific business environments
  • Work with a big data team at a global financial services company
  • Should know Java and Hadoop (or other known big data systems for large scale data processing) well enough to creatively problem-solve
  • Must have practical experience and know-how
  • Responsible for building and supporting a Big Data based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured data
hadoop-job-img

Data Engineer

company-icon Amazon Corporate LLC

   US-NY-New York
   17th Sep, 2016
Job Description:
  • You will be part of a team of creative, top-notch software developers to work hard, have fun, and make history. Software engineers at Amazon are more than just order takers; they see a problem and leverage innovative technology to address it.
  • You will be working with very large data sets, well beyond the scalability limits of conventional relational databases. We're looking for people who innovate, love solving hard problems, and never take "no" for an answer. 
  • Our team is within Retail Financial Intelligence Systems and develops sophisticated tools for the Amazon Retail businesses, supporting deep dive analysis, vendor negotiations and business planning towards enhancement at the bottom line. We also provide financial and operational reports to Amazon retail vendors worldwide
hadoop-job-img

Software Engineer

company-icon Barbaricum

   Washington, DC Metro
   15th Sep, 2016
Job Description:
  • Leads development of software applications and solutions.
  • Design, develop code, documentation, and test software.
  • Scrape data from numerous sources to be ingested into large databases for use by analysts.
  • Assist in the acquisition, repurposing, and analysis of data from the Internet and various administrative sources.
  • Formulate and define system scopes, objectives and plans for execution through research and fact finding to develop/deploy/modify complex interconnected systems.
  • Provide relational and dimensional data modeling, database design, technical design, and extract/transform/load (ETL).
  • Design, develop, implement, and assist in validating ETL processes.
  • Develop data analysis and data modeling of various social media platforms.
  • Provide on-going software development efforts in support of multiple projects.
hadoop-job-img

Hadoop Big Data Engineer

company-icon Meridian Health Plan

   MI-Detroit
   06th Sep, 2016
Job Description:
  • Install and configure Hadoop components and related utilities
  • Develop processes for source data ingestion, transformation, and database loading
  • Develop processes for data quality monitoring
  • Develop processes to support “Data as a Service (DaaS)”
  • File system management, monitoring, support and maintenance for HDFS, KUDU, and HBASE
  • Create scalable and high-performance web services for data tracking
  • Assisting with data lake folder design
  • Recommending and establishing security policies and procedures for the Hadoop environment
  • Assisting in the development and implementation of various strategic initiatives.
  • Contribute to development of Architecture Policies, Standards and Governance for the Hadoop and Big Data environment
  • Research and development with promising leading edge big data technologies
  • Participating in data architecture design and review processes, including planning and monitoring efforts, reviewing deliverables, and communicating to management
  • Responding to change and engaging in multiple projects simultaneously
  • Works with minimal guidance; seeks guidance on only the most complex tasks
hadoop-job-img

Big Data Hadoop Consultant

company-icon Accenture

   Chicago
   29th Aug, 2016
Job Description:

YOUR ROLE: Analytics Delivery – Big Data Consultant

· Deliver large-scale programs that integrate processes with technology to help clients achieve high performance.

· Design, implement and deploy custom applications on Hadoop.

· Implementation of complete Big Data solutions, including data acquisition, storage, transformation, and analysis.

· Design, implement and deploy ETL to load data into Hadoop.

hadoop-job-img

BI and Analytics Developer

company-icon Johns Hopkins University

   Baltimore
   24th Aug, 2016
Job Description:

Primary Responsibilities and Duties:

Analysis and Requirements Gathering (25%)

Define complex business/clinical/education problems by meeting with clients to observe and understand current processes and the issues related to those processes. Provide written documentation of findings to share with the client and other IT colleagues.

Gather complex system requirements by meeting with clients and researching existing technology to understand the business requirements and possible solutions for new applications.

Design and Development (25%)

  • Lead semantic design through SQL development and BI tools to refine presentation of data to meet reporting needs.
  • Develop detailed tasks and project plans by analyzing project scope and milestones for complex projects in order to ensure product is delivered in a timely fashion according to software lifecycle standards.
  • Write functional/technical specifications from the complex system requirements, putting them into functional and technical descriptions for use by programmers and business analysts to develop technical solutions.
  • Develop/change data input, files/database structures, data transformation, algorithms, and dataoutput by using appropriate computer language/tools to provide technical solutions for complex application development tasks.
  • Document code and associated processes by adhering to development methodologies, adding code comments and appropriate documentation to various knowledge-base system(s) to simplify code maintenance and to improve support.
  • Provide monitoring and guidance in application design and development to more junior staff.
  • Provide thought leadership in designing and developing innovative integrated solutions.

Testing and Documentation (25%)

  • Responsible for unit, integration, stress/load testing of reports and dashboards to ensure functional and performance requirements are met.
  • Test all changes by using the appropriate complex test scenarios to ensure all delivered solutions work as expected and errors are handling in a meaningful way.
  • Create and document complex test scenarios using the appropriate testing tools to validate and verify application functionality.
  • Author and maintain documentation by writing audience-appropriate materials to serve as technical and/or end-user references.
  • Ensure documentation of requirements, design, testing and user guides meets departmental and professional standards.
  • Mentor junior staff in testing tools and technologies by reviewing their work.

Implementation and Maintenance (25%)

  • Implement changes by adhering to the change management policies and procedures for any given project to communicate to all parties the nature, significance, and risk factors of the solution.
  • Monitor changes and resolve complex problems by responding as they occur, by reviewing all processing and output of the newly implemented solution, and by proactively ensuring the solution works successfully in order to satisfy the customer requirements and to provide a smooth transition to the new solution.
  • Provide support by investigating and resolving issues, including complex issues to ensure prompt, effective service.
hadoop-job-img

Sr. Hadoop Engineer

company-icon Aruba

   Sunnyvale, CA
   19th Aug, 2016
Job Description:

We are looking for rockstar engineers to help build highly scalable, real time and reactive cloud analytics platform for IoT using some of the cutting edge open source technologies including likes of Yarn, Spark, Akka, Kafka, NoSQL etc. 

hadoop-job-img

Hadoop Developer

company-icon Spring Lake Consulting

   Charlotte, NC
   15th Aug, 2016
Job Description:

• Hadoop development and implementation. 
• Loading from disparate data sets. 
• Pre-processing using Hive and Pig. 
• Designing, building, installing, configuring and supporting Hadoop
• Translate complex functional and technical requirements into detailed design. 
• Perform analysis of vast data stores and uncover insights. 
• Maintain security and data privacy. 
• Create scalable and high-performance web services for data tracking. 
• High-speed querying. 
• Managing and deploying Hbase (Optional). 
• Being a part of a POC effort to help build new Hadoop clusters. 
• Test prototypes and oversee handover to operational teams. 
• Propose best practices/standards.

 

 

hadoop-job-img

Hadoop Developer

company-icon Anteo Group/The CSI Companies

   Atlanta, GA
   03rd Aug, 2016
Job Description:

Work as part of a DevOps team to deliver cloud-based analytics solutions, including real-time stream processing and analytics, IoT data ingest/storage/analysis, RESTful APIs to expose insights to external applications and mobile apps, model business concepts in SQL/NoSQL databases and key/value stores. Work with emerging technologies in the big data space.


The developer will be working with consuming and processing large real time streams of data, transforming and processing data streams, caching and exposing data with RESTful endpoints in addition to other application specific functionalities.

hadoop-job-img

Hadoop Data Analyst Consultant - Dearborn, MI (exp w/apache hadoop, madreduce) in Dearborn, Michigan

company-icon CSC

   Dearborn, Michigan
   28th Jul, 2016
Job Description:

· Support the development and delivery of these models using skills such as data acquisition and management, algorithm design, and model development and refinement.

· Projects involve understanding the essence of business problems, translating them into appropriate mathematical representations, encoding these abstractions into prototype computer programs or models, and interpreting and communicating results to technical and non-technical audiences.

· Participates in gathering technical requirements through a variety of techniques (e.g., facilitated workshops, work sessions and interviews); performs technical analysis and design to the sub-system level (Technical).

· Develops program specifications for all levels of complexity; codes programs from high level specifications or Derived Logical Processes (DLPs) on two or more technical platforms; optimizes program performance and maintainability. Raises business application prototypes to production levels (Technical).

· Defines technical requirements to support a data conversion effort and executes automated and manual data cleansing procedures (Technical).

· Develops standards, templates, and procedures to aid in the development of the required work products (Methodology).

· Leads a team of 4-6 company resources, in area of expertise, to conclusion of a project phase (Management).

· Conducts performance and integration testing, helps analyze test results, and assists in identifying modifications or necessary improvements (Business).

· Establishes and maintains networking relationships with middle management in client organizations (Relationship Management).

· Understands client needs and matches them to relevant services or products; manages client expectations (Leverage).

· Understands and communicates goals and critical success factors for the project; sells ideas persuasively and paces the communications properly (Communication).

hadoop-job-img

Senior Hadoop developer with J2EE

company-icon Net Serpents LLC

   Foster City, CA
   22nd Jul, 2016
Job Description:

Guide the team to architect, design & code

Write Java code for Web Services using J2EE stack

Conduct design reviews

Ensure that the design/implementation is highly modular, portable and performance optimized

Mentor team members

hadoop-job-img

HADOOP ARCHITECT

company-icon Somasoft

   Bellevue, WA
   15th Jul, 2016
Job Description:

Design and Solution Architect experience in Hadoop platforms.

Work under client team guidance on evolving big data architecture.

hadoop-job-img

Hadoop Developer - New York, NY - up to $180K + bon

company-icon Investment/asset management firm in the heart of M

   New York, USA
   11th Jul, 2016
Job Description:

-Design and develop a Hadoop (Big Data) Platform 
-Write high-performance code 
-Write MapReduce jobs 

Only individuals who do not require any form of sponsorship are eligible for consideration 
If you think that you would be a great fit for the role please feel free to contact Argina at a.girsang@washingtonfrank.com or call at (646) 576-7670. 
Washington Frank International is the leading global recruitment company for Microsoft and ERP specialists. 

hadoop-job-img

Big Data Engineer - Python, Spark, Hadoop, Scala

company-icon CyberCoders

   San Francisco, CA
   01st Jul, 2016
Job Description:

- Extract, validate, transform and summarize data generated from databases and big data structures
- Analyze business metrics in order to correlate and model against it
- Develop tracking mechanisms to track and monitor performance over time

hadoop-job-img

Hadoop Application Developer

company-icon Apple Inc.

   Cupertino, CA
   29th Jun, 2016
Job Description:

Hands-on Hadoop developer will be responsible for the translation of user requirements and system objectives into logical, efficient, and practical workflow designs and Programs.
This person will be preparing detailed datafile, schema, and program specifications from which new systems will be developed and/or existing systems modified.
The ability to work independently toward the completion of project milestones.
Developing detailed specifications for the creation of new or modified programs, including the recommendation of logical designs, record/report layouts, and screen designs.
Designing program logic to perform business requirements efficiently and reliably.
Developing and executing unit and systems test plans that will thoroughly exercise system integration.
Performing business and BI requirement analysis, lead design and develop logical data models by translating business needs into technical solutions.
Act as a technical resource for others within the group.

hadoop-job-img

Hadoop Developer at Ciber

company-icon Ciber

   Dearborn, MI 48120
   21st Jun, 2016
Job Description:

Work within the IT GDIA group to develop and implement standard load and land process. 

hadoop-job-img

Hadoop Developer - New York, NY - up to $180K + bon

company-icon Nigel Frank International

   New York, NY
   20th Jun, 2016
Job Description:

-Design and develop a Hadoop (Big Data) Platform 
-Write high-performance code 
-Write MapReduce jobs 
-Experience writing Pig Latin scripts 
-Experience using visualization tools such as PowerBI or Qlik 
-Knowledge of Oozie 

hadoop-job-img

Hadoop Developer/Engineer

company-icon TEG GLOBAL

   San Diego, CA
   03rd Jun, 2016
Job Description:
  • Provide technical and development support to build and maintain a modernized Enterprise Data Warehouse (EDW) by expanding the current on-premises Hadoop cluster to accommodate an increased volume of data flowing into the enterprise data warehouse.
  • Perform data formatting involves cleaning up the data.
  • Assign schemas and create HIVE tables Apply other HDFS formats and structure (Avro, Parquet, etc. ) to support fast retrieval of data, user analytics and analysis
  • Assess the suitability and quality of candidate data sets for the Data Lake and the EDW Design and prepare technical specifications and guidelines.
  • Act as self-starter with the ability to take on complex projects and analyses independently
  • Ensure secure coding practices are adhered to in all phases of the secure development lifecycle.
  • Be knowledgeable in all NGC SSA Programs HIPAA compliance requirements and proactively address any HIPAA concerns.
  • Become knowledgeable on the HIPAA policies and procedures for the program and ensure awareness of HIPAA breach process.

 

hadoop-job-img

Hadoop Developer

company-icon Saama Technologies Inc

   Campbell, CA
   24th May, 2016
Job Description:
  • Execute Hadoop development projects independently as well as leading the project
  • Analyze complex distributed production deployments, and make recommendations to optimize performance
  • Deliver programming results that meet specs and functional requirements on time
  • Align project team and client as requirements change
  • Use Saama methods and IP to effectively contribute high quality work to Client projects and Saama Solutions
  • Drive innovation across practice in project management, technology and client relationships
  • Manage the offshore teams as well as be the liaison for the local and the offshore team
hadoop-job-img

Senior Big Data Engineer

company-icon ROBLOX

   San Mateo, CA
   11th May, 2016
Job Description:
  • Next generation search and discovery for games, immersive worlds and other user-generated content like models.
  • Personalization and Recommendation systems.
  • Harvesting billions of events to gain operational and business insight into the performance and optimization of the Roblox platform.
  • Building complex production-quality algorithms and data pipelines that mine large data sets.
  • Work closely with product, engineering and business leads in generating dashboards, reports and summary data that feed into platform behaviour.
  • Build and maintain the infrastructure collect and transform raw data across the Roblox stack.
hadoop-job-img

Senior Developer

company-icon Interactive Data

   New York, NY
   07th May, 2016
Job Description:
  • Collaborate with key business and technology stakeholders to lead functional and technical design sessions.
  • Work closely with software engineering team and senior leadership to design and implement end-to-end solutions.
  • Design, develop and implement full stack solutions using Java, Spring Security, Spring/JPA, Hibernate, MySQL, HSQLDB and NoSQL DBs.
  • Be able to lead and/or participate in project efforts using an Agile development methodology.
  • Collaborate with QA to develop comprehensive and appropriate test strategies for each release.
  • Develop system and training documentation as needed.
  • Must be able to work flexible hours as needed to support project timelines and deliver efforts on time.
  • Provide technical programming support or provide subject matter expertise to other team members as needed.
hadoop-job-img

Senior Developer

company-icon Interactive Data

   New York, NY
   07th May, 2016
Job Description:
  • Collaborate with key business and technology stakeholders to lead functional and technical design sessions.
  • Work closely with software engineering team and senior leadership to design and implement end-to-end solutions.
  • Design, develop and implement full stack solutions using Java, Spring Security, Spring/JPA, Hibernate, MySQL, HSQLDB and NoSQL DBs.
  • Be able to lead and/or participate in project efforts using an Agile development methodology.
  • Collaborate with QA to develop comprehensive and appropriate test strategies for each release.
  • Develop system and training documentation as needed.
  • Must be able to work flexible hours as needed to support project timelines and deliver efforts on time.
  • Provide technical programming support or provide subject matter expertise to other team members as needed.
hadoop-job-img

Big Data Java Developer

company-icon Workbridge

   New York, NY
   04th May, 2016
Job Description:

The Big Data Java Developer will be working to do primarily brand new development alongside some of the most talented engineers in the business across the full Java & rails stack (with Hadoop, MySQL, AWS, Pig and Hive). It's very cutting edge, very collaborative, and extremely agile. The office is simply spectacular, with a wrap-around terrace, multiple game and lounging spaces, automated standup desks, and plenty of other perks like snacks, drinks, and team activities.

hadoop-job-img

Hadoop Developer

company-icon RangTech

   New York, NY
   30th Apr, 2016
Job Description:

Responsibilities:
•    Hadoop development and implementation.
•    Loading from disparate data sets.
•    Pre-processing using Hive and Pig.
•    Designing, building, installing, configuring and supporting Hadoop.
•    Translate complex functional and technical requirements into detailed design.
•    Perform analysis of vast data stores and uncover insights.
•    Maintain security and data privacy.
•    Create scalable and high-performance web services for data tracking.
•    High-speed querying.
•    Managing and deploying HBase.
•    Being a part of a POC effort to help build new Hadoop clusters.
•    Test prototypes and oversee handover to operational teams.
•    Propose best practices/standards.

hadoop-job-img

Hadoop Infrastructure Engineer - Foundational Services

company-icon Bloomberg

   New York, NY
   28th Apr, 2016
Job Description:
  •  Evaluate Hadoop projects across the ecosystem and extend and deploy them to exacting standards (high availability, big data clusters, elastic load tolerance)
  •  Develop automation, installation and monitoring of Hadoop ecosystem components in our open source infrastructure stack, specifically HBase, HDFS, Map/Reduce, Yarn, Oozie, Pig, Hive, Tez, Spark and Kafka
  •  Dig deep into performance, scalability, capacity and reliability problems to resolve them
  •  Create application patterns for integrating internal application teams and external vendors into our infrastructure
  •  Troubleshoot and debug Hadoop ecosystem run-time issues
  •  Provide developer and operations documentation to educate peer teams
hadoop-job-img

Senior Hadoop Developer

company-icon R & T Consulting

   New York, NY
   26th Apr, 2016
Job Description:

The group's aim is to create standardized solutions to complex yet common problems across Engineering. It deals with challenges of storage, low latency retrievals, high volume requests, scalability and high availability over a distributed environment for enterprise wide use.

We are updating many facets of our data and analytics infrastructure. This includes, PriceHistory, our end of day time series datastore and our Query Platform - a standardized query framework that allows users to express complex data retrieval, analytics and screening criteria

Our challenges stem from the low-latency, high throughput and high availability necessary for our applications

A successful candidate will have proven experience with the Hadoop stack and NoSQL data stores (preferably HBase or Cassandra). He/she should have experience working on critical infrastructure and a strong desire to drive a product forward. The candidate must exhibit a passion for big data technologies and a flexible creative approach to problem solving.

hadoop-job-img

Hadoop / Java Developer, Big Data Analytics

company-icon Gambit Technologies

   New York, NY
   21st Apr, 2016
Job Description:

We are looking to use open source technologies to build much of our infrastructure. If you are already a contributor to projects such as HBase, Kafka or Spark and understand open source contribution models we want to talk to you. You should also have strong systems-level Java and performance engineering expertise.
 

hadoop-job-img

Hadoop/Java Applications Developer

company-icon JPMorgan Chase

   New York, NY
   19th Apr, 2016
Job Description:

J.P. Morgan is a global leader in asset and wealth management services. We serve institutional, high net worth and retail clients through J.P. Morgan Asset Management; Highbridge Capital Management; and Private Banking, which includes the Private Bank, Private Wealth Management, and J.P. Morgan Securities. We are one of the largest asset and wealth managers in the world.

The Core Components and Architecture (CCA) group within the Technology division of J.P. Morgan Asset Management serves all aspects of the business, providing best in class architecture solutions and services used as the foundation for technology development.

 

The CCA group is currently seeking a Hadoop engineer to join the Big Data platform team.  As a member of the Big Data team, you will work closely with the business and technology partners to create custom solutions to leverage distributed computing systems in their applications, while adhering to development best practices and standards and focus on building reusable and extendable code.

 

hadoop-job-img

Hadoop Java Developer

company-icon QED National

   New York, NY
   15th Apr, 2016
Job Description:

* Build and implement front-end web applications and back-end services that integrate with other products.
* Interact with clients both within JPMIS and across the firm (including counterparts in Retail & Wholesale Banking, Risk, Digital/Mobile)
* Validate requirements and system design
* Automate and streamline existing processes, procedures, and toolsets
* Ensure code paths are unit tested and defect free
* Participate in full integration testing
* Rapidly address issues and fix defects discovered during deployment

hadoop-job-img

Big Data Hadoop Developer

company-icon ZaranTech

   New York, NY
   12th Apr, 2016
Job Description:
  • Must be able to design, build, configure and support Hadoop
  • Must develop and implement Hadoop.
  • Translate complex, functional and technical requirements in to detailed design.
  • Create scalable and high performance web services for data tracking.
  • Test prototypes and oversee handover to operational teams.
  • Manage and deploy HBase and should maintain security and data privacy.
  • Propose best practices and standards.
  • Must be a part of POC effort to help build Hadoop clusters.
hadoop-job-img

Hadoop Developer and Hadoop Administrator

company-icon Ikya Human Capital Solutions Pvt Ltd

   Chennai
   08th Apr, 2016
Job Description:

 

  • Experience with relational database technologies (Oracle, SQL Server, MySQL), inclusive of data Modeling and a working knowledge of SQL
  • Prefer experience with Cloudera Hadoop distribution components and custom packages.
  • Prefer experience with columnar DB solutions (e.g. Vertica, Cassandra, Greenplum) in cases where a columnar DB is best for data management
  • Working experience on Maintenance Projects.
  • Hands on expertise gathering requirements, designing, building, and implementing Data Integration applications.
hadoop-job-img

Big Data Architect

company-icon Stride Search

   Redwood Shores, CA
   05th Apr, 2016
Job Description:
  • Design and develop backend server-side components that drive AutoGrid’s machine learning systems
  • Integrate and utilize big data technologies to support massive scalability, reliability and performance.
  • Define and implement requirements for predictive control and forecasting applications
  • Benchmark and debug critical algorithm and software issues
  • Work closely with product management, data science and QA teams to manage the full software lifecycle including requirements, architecture, algorithmics and QA
  • Assist DevOps in troubleshooting product issues in production and demo systems 
  • Lead and mentor junior developers

 

hadoop-job-img

Big Data Chief Architect

company-icon Daugherty Business Solutions

   Chicago, IL
   01st Apr, 2016
Job Description:

Daugherty is seeking an innovative and creative consultant with the deepest technical skills in the Big Data space gained through hands-on experience with enterprise scale applications and systems. We are actively seeking a consultant with a passion for leveraging emerging technologies and next generation architectures to solve business problems. The ideal candidate will have a strong entrepreneurial spirit and the ability to teach, mentor, advise clients on their plans, and take charge of a hands-on delivery team, as well as the ability to support engagement of clients on potential business opportunities. This role will require deep hands-on technical skills in architecting, designing, developing and implementing large-scale Big Data solutions.

hadoop-job-img

Big Data Software Engineer

company-icon Ciber

   Tampa, FL
   30th Mar, 2016
Job Description:

Role Description:

Ciber is assisting a large health plan provider in a long-term data integration project.We are searching for a software engineer to join our team as a full-time employee in Tampa, FL.

Essential Functions: 

·Acts as principle contributor to technical feasibility studies, business cases, proposals and 3rd party assessment.

·Prepares detailed functional specifications, design models and system workflows from which software applications will be developed and implemented.

·Supports, troubleshoots and maintains production systems as required. Optimizing performance, resolving problems and providing timely follow-up on identified issues.

·Defines and maintains IT development standards and best practices.

hadoop-job-img

Software Engineer, Hive

company-icon Cloudera

   San Francisco, California
   28th Mar, 2016
Job Description:

Responsibilities:

  • Design and implement engineering systems that scale well – to petabytes of data and tens of thousands of nodes
  • Deliver functionality that integrates seamlessly with compute and storage frameworks
  • Formulate and present architecture and design documents internally and to the open source community
  • Analyze large-scale distributed systems to identify performance bottlenecks, failure points, and security holes
  • Introduce and promote new technologies to the world through blogs and conference presentations
  • Location San Francisco or Palo Alto
hadoop-job-img

Hadoop Developer

company-icon BTI Solutions

   Ridgefield Park, Bergen, NJ
   25th Mar, 2016
Job Description:

General Description:
The role will primarily responsible for the actual coding or programming of Hadoop applications.

Essential Functions:
The candidate will responsible for installing, configuring and maintaining multiple Hadoop clusters in the organization. As a Big Data Administrator you will work with development teams to optimize different Hadoop services and deploy and code in to multiple environment. This is a unique opportunity for a highly motivated individual to work on the next generation decision support system.

Overview of Hadoop Jobs in USA

Counselors will tell you that the big data market is hot. Companies are looking desperately to fill the huge numbers of open Hadoop developer positions. They are not wrong. They are speaking in a general sense. Let's review the Hadoop jobs in USA scene.

Every Big Data related role in the U.S. will create employment for 3 people outside of IT. So in the next 3 years, a total of 6 million jobs will be generated by the information economy.

Peter Sondergaard, Analyst at Gartner

And that is just an estimate of Hadoop jobs in USA.

Worldwide, there are 6000+ open Hadoop jobs, of which 60% of the Hadoop job listings are in USA. Depending on the level of experience in other technologies or background of the applicant , the Hadoop developer salaries ranges from $70,000 to a whopping $190,000.

Global Growth in Hadoop Jobs

Technology is the one thing, you can bank on to NOT remain constant. Today, if Hadoop is making waves in the Big Data sector, tomorrow, there might be others that will take over. This is true to some extent. But let us look at some data and statistics which will support the statement - Hadoop will be around for a long time!

Transparency Market Research published a new market report on March 22, 2016, "Hadoop Market - Global Industry Analysis, Size, Share, Growth, Trends and Forecast 2015 - 2023" in which they valued the global Big Data and Hadoop market at 4,120 million USD in 2014 and expected to grow at a CAGR of 28.4% from 2015 to 2023. In 2023, the Big Data and Hadoop market will be valued at 37,759 million USD.

The industries that will be leading the enterprise wide Hadoop adoption is the IT & ITES, followed by the telecommunication industries. BFSI and retail will not be far behind in rapidly adopting Hadoop for analysing and working on big data solutions.

North America is the leading adopter of Hadoop technologies and it will continue to be on top with 50% of the revenue share. Europe is starting to catch up on the growing big data and Hadoop market. UK, Germany and France are on the forefront in the implementation of Hadoop to create viable big data products.

These statistics lead us to believe that the Big Data and Hadoop market is definitely on the rise and will continue to grow at a steady pace for quite a number of years. If you are still in doubt as to the growth of the Hadoop market, then take a look at what the experts have to say. These insights are taken from insideBigData.com:

Hadoop projects mature! Enterprises continue their move from Hadoop Proof of Concepts to Production. In a recent survey of 2,200 Hadoop customers, only 3 percent of respondents anticipate they will be doing less with Hadoop in the next 12 months. 76 percent of those who already use Hadoop plan on doing more within the next 3 months and finally, almost half of the companies that haven't deployed Hadoop say they will within the next 12 months. The same survey also found Tableau to be the leading BI tool for companies using or planning to use Hadoop, as well as those furthest along in Hadoop maturity.

Dan Kogan, Director of Product Marketing at Tableau

In 2016, I predict many companies will use Hadoop for wide-scale, large deployments as they move out of a 'lab'. Gone are the days when Hadoop deployment was limited to small-scale trial environments.

David Richards, WANdisco's CEO

Hadoop for Mission Critical workloads. In 2016, Hadoop will be used to deliver more mission critical workloads - beyond the "web scale" companies. While companies like Yahoo!, Spotify and TrueCar all have built businesses which significantly leverage Hadoop, we will see Hadoop used by more traditional enterprises to extract valuable insights from the vast quantity of data under management and deliver net new mission critical analytic applications which simply weren't possible without Hadoop.

Scott Gnau, Chief Technology Officer, Hortonworks

Salaries for both data scientists and Hadoop admins will skyrocket in 2016 as growth in Hadoop demand exceeds the growth of the talent pool. In order to bypass the need to hire more data scientists and Hadoop admins from a highly competitive field, organizations will choose fully managed cloud services with built-in operational support. This frees up existing data science teams to focus their talents on analysis instead of spending valuable time wrangling complex Hadoop clusters.

Mike Maciag, COO, Altiscale

To know more on which companies are using Hadoop, you can click here to read more.

So have we established beyond a shadow of doubt that Hadoop is here to stay and it will be worthwhile to build a career in Hadoop and Big Data? I am pretty sure we have!

Hopefully you are assured that you are right to develop your Hadoop career now. Strike the iron while it's hot!

Step 1: Research Opportunities

Since we are taking it in stages, let us again review what all we need to know to dive into a new technology.

Research on the career opportunities and market growth of Hadoop.

We have done a bit of it for you above. You can also peruse these articles to get a better idea of the Hadoop job market.

  1. Big Salaries for Big Data Hadoop Jobs

    • This will give you an idea on the average salaries for Hadoop jobs in USA. Give the salary form here.
  2. Interview Tips to Get Hired by Big Data Hadoop Companies

    • This article is a synopsis of the talk given by a Hadoop recruiter in US. He discusses the finer points on what recruiters look for in your Hadoop job resume.
  3. Companies using Hadoop for Big Data solutions

    • This article gives you a list of companies that are currently using Hadoop. This will give you an idea of the popularity of Hadoop in the market, how Hadoop is used in these companies and the opportunity to apply for Hadoop developer job roles in these companies.

But we can't stress enough on how important it is to do research on your own. You can go through job sites like dice.com, indeed.com, Linkedin - to see which kind of companies are hiring Hadoop developers and what kind of skills are they looking for. Then prepare a comparison list of the skills you have and the skills that you need to learn to bag a Hadoop job. This will give you a clear perspective of where you stand, how much you know or if you need to learn Hadoop from scratch.

Step 2: Know Required skills

Know the skills that is needed to get a job as a Hadoop developer/admin.

Yes. This is a bitter truth. Not everybody is suitable to become a Hadoop developer or a Hadoop admin.

  So who can be a Hadoop developer?

  • To become a Hadoop developer, you need to have a programming background. If you are out of touch with programming - then you will find the concepts a little difficult to grasp. Companies assume that candidates applying for a Hadoop developer job role are ready to code. And code you must. Your job role of a Hadoop developer will demand it.

DeZyre career counselors often get questions of this sort:

For a Java developer, becoming a Hadoop developer is but the natural career progression. A key component of Hadoop is MapReduce and MapReduce is nothing but Core Java Code. So if you have a Java background you start of with a strong advantage. Once data is stored in Hadoop databases like Hbase or MongoDb, the MapReduce framework is used to analyze this data. So if you know Java, the functions in MapReduce are very similar.

There is a huge demand for Hadoop developers in the market. For every 100 Hadoop developer roles out there, there are only 5 qualified applicants. Since you are already a Java developer - Hadoop is the next natural progression in your career. Hadoop developers usually get paid 30% more than any other developers.

Also check out 5 reasons why Java developers should learn Hadoop.

Yes you can. MapReduce is popularly used as an ETL tool in Hadoop. A core aspect of Hadoop ETL is understanding the idea of a distributed database. With your background I am sure you are very familiar with ETL in a RDBMS environment. But in the Hadoop clusters data resides in an unstructured form and in a distributed manner. Through our course you will learn how to perform ETL in a distributed datastore environment.

Since you are from ETL, you must be familiar with SQL right? Great, so then Hadoop is a logical next step. You will use a combination of data loading tools such as Flume and Sqoop along with analysis tools such as Pig and Hive. If you know SQL, then Pig and Hive are similar - Pig has Pig Latin and Hive has HiveQL that are similar to SQL.

Here is why ETL professional should learn Hadoop. It is all explained in details. Make sure you go through it.

Mainframe is a dying technology. So yes, the sooner you shift to Hadoop the better it is for your career. Mainframes were popular at a time, but now they are becoming an obsolete technology, for the processing and analysis of data needs a faster and cheaper technology, considering the huge amount of unstructured data that is being generated.

For example, if Mainframes had to analyse 1 TB of data, it would take about 45 secs to compute, whereas with Hadoop, you can analyse that data in 1/10 th of the time, due to Hadoop's unique distributed computing system.

Companies will surely move to Hadoop clusters and abandon Mainframes, as they are cheaper and easier to maintain being an open source technology.

Learn why it is wise to make a career change from Mainframe to Hadoop now.

Upgrade your skills with Industry Expert led Online Hadoop Training

Well, we have covered who can become a Hadoop developer, but we are yet to answer who can become a Hadoop admin?

Anyone who is from a System admin background can become a Hadoop admin. It does not require much programming background to become a Hadoop administrator. To learn Hadoop administration, check out the Hadoop admin online training course.

Step 3: Learn Hadoop Tools

Find out if you have learnt all the tools in Hadoop and have a hands on experience in working on the Hadoop ecosystem.

These are some of the Hadoop components and tools, you need to be familiar with if you are applying for a Hadoop developer job role.

  1. HDFS:

    This is a highly fault tolerant file system that runs on commodity hardware. It is the primary storage system for Hadoop applications and defines Hadoop's key feature of distributed computing. It is designed to store very large data sets reliably.

  2. MapReduce:

    MapReduce is written in Java. It is a system where the data that is stored in HDFS gets processed efficiently. MapReduce breaks the data processing job into smaller tasks and runs analysis on the distributed data parallelly.

  3. Pig:

    Apache Pig was developed by Yahoo as an abstraction on top of MapReduce. It is easier to use than MapReduce as it provides a high level data flow language to analyse data.

  4. Hive:

    Hive was developed by Facebook on top of MapReduce and it provides a simple language for processing data, that is HiveQL, similar to the SQL we use.

  5. Sqoop:

    Sqoop is used to load structured data into HDFS.

  6. Flume:

    Flume is used to aggregate data from unstructured sources and load them into Hadoop.

Check out the complete list of Hadoop components and architecture that you should be familiar with before applying for a Hadoop developer or Hadoop Admin position.

Step 4: Work on Hadoop Projects

Have you enough hands on working knowledge on Hadoop or have you worked on Hadoop projects to make a favourable impression on recruiters who are hiring for Hadoop jobs?

  • This is important. Hadoop is not a technology for which freshers are hired. There is a reason why companies look to hire experienced professionals for Hadoop jobs. When we say experienced professional - we do not mean experienced in Hadoop. You will need to have experience (at least 2 years) in working with other technologies. Freshers rarely get hired for Hadoop developer job roles.
  • One more detail that will make your resume stand out from thousands of others is - the number of Hadoop Projects that you have worked on. The Hadoop developer job interviews will test your practical knowledge rather than a theoretical understanding on Hadoop.
  • Make sure you have practiced enough with openly available data sets to interest the recruiters to look at your resume for that Hadoop job.

Step 5: Prepare a Hadoop Resume

Prepare a detailed resume for your Hadoop developer/admin job role.

What do recruiters look for when they are combing through the thousands of Hadoop job resumes that come in for any position. Anyone applying for a Hadoop developer or a Hadoop admin role will have learnt Hadoop from a reputed institution. They might have some high profile Hadoop certifications from Cloudera, IBM or Hortonworks. So what will differentiate you and get you hired for the Hadoop job?

It is clarity. Clarity in mentioning your skills and hands on experience in working on Hadoop. You will find more detail on how to write your Hadoop resume in this post.

Step 6: Hadoop Interview Q&A

Read through and prepare all possible Hadoop Interview Questions.

It is self explanatory on why you need to do this. The academic team at DeZyre has worked on a series of Hadoop Interview questions that will help you prepare for that Hadoop job. Check them out. They will help you immensely.

Follow these 6 steps and you will not be far from achieving your goal of starting your Hadoop career. These steps will not guarantee you a Hadoop job but it will ensure that you are on the right path to become a Hadoop developer or a Hadoop admin.

Hadoop Job Roles

The 4 different Job Roles available for Hadoop Professionals

Hadoop Developer Job Role:

A Hadoop developer is the one who is responsible for programming Hadoop applications. A Hadoop developer should have the ability to write MapReduce jobs for analysis of the data stored in the cluster, should have experience in writing PigLatin scripts, has hands on experience in HiveQL, should know Flume/Sqoop and needs to have knowledge of the workflow scheduler - Oozie.

Hadoop Architect Job Role:

A Hadoop Architect is at a higher pay grade than a Hadoop developer. He/She is responsible for designing the next generation systems architecture. A Hadoop architect must have subject matter expertise in the different Hadoop distributions and vendors like Cloudera, Hortonworks, Amazon EMR, etc and must be familiar with MapReduce, Hive, Pig and Java.

Hadoop Admin Job Role:

The role of a Hadoop Admin is similar to that of a System Admin, but in the Hadoop ecosystem. A Hadoop admin is responsible for configuring and monitoring a Hadoop cluster. A Hadoop admin should have expertise in hardware and a thorough knowledge of the Hadoop components and architecture.

Hadoop Tester Job Role:

A Hadoop tester has similar responsibilities as that of any other software application tester. A Hadoop tester's role is to find out if there is any bug in the Hadoop applications running in the cluster. He/She needs to know Java - for testing MapReduce jobs, write MRUnit queries - similar to JUnit queries to test the jobs. Knowledge of Hive and Pig is a requirement in those companies that use these instead of MapReduce to analyze data.

processing person-icon