Hive/Spark Big Data Developers/Engineers

Company Name: Knowledgent Group Inc.
Location: Massachusetts
Date Posted: 19th Apr, 2018
Description:

Roles and Responsibilities

  • Build high volume data integrations
  • Develop Hadoop architecture, HDFS commands
  • Design & optimize analytical jobs and queries against data in the HDFS/Hive environments
  • Develop Spark framework
  • Build data transformation and processing solutions
  • Develop bash shell scripts, UNIX utilities & UNIX Commands
  • Integration with Salesforce / Veeva CRM / Adobe Experience Manager / Google Analytics / External data sources and other applications.
Qualification:

Required Functional/Technical Skills and Experience

  • Strong knowledge in Hadoop architecture, HDFS commands and experience designing & optimizing analytical jobs and queries against data in the HDFS/Hive environments
  • Strong knowledge in Spark Framework
  • Strong expertise in Java, Scala, Python, Hive,, MySQL or NoSQL or similar
  • 5 - 8 years of progressively complex related experience in data engineering
  • 3 to 4 year of working experience in Big Data stack on HDP or similar environments
  • Strong knowledge of large scale data applications and building high volume data integrations
  • Experience building data transformation and processing solutions
  • Experience with bash shell scripts, UNIX utilities & UNIX Commands
  • Working knowledge and/or integration experience with salesforce / Veeva CRM / Adobe Experience Manager / Google Analytics / External data sources and other applications