Hadoop Scala Developer

About This Role

Developing and maintaining large-scale Big Data solutions using Hadoop ecosystem technologies is the primary focus of this role. The developer will create data ingestion, transformation, and processing frameworks, build reusable backend services, and optimize Spark applications.

Responsibilities

• Design, develop, and maintain large-scale Big Data solutions using Hadoop ecosystem technologies
• Develop data ingestion, transformation, and processing frameworks using Scala, Spark, and Hadoop
• Create and maintain Shell scripts for automation, monitoring, deployment, and operational support
• Build reusable and scalable backend services using Java and Spring Boot
• Develop and optimize Spark applications for batch and real-time data processing
• Design and implement RESTful APIs and microservices using Spring Boot
• Work with HDFS, Hive, Sqoop, Kafka, Oozie, and other Hadoop ecosystem components
• Perform performance tuning and optimization of Hadoop and Spark jobs
• Troubleshoot production issues and provide L2/L3 support for critical applications
• Collaborate with business analysts, architects, DevOps teams, and other stakeholders
• Participate in code reviews, unit testing, CI/CD implementation, and release activities
• Ensure compliance with enterprise security, governance, and data quality standards

Requirements

• Primary Skill: Hadoop, Scala, Shell scripting
• Secondary: Java, Spring Boot

Important Details

• Locations: Charlotte NC; New Jersey