Hadoop Engineer

Hadoop Engineer Location: Summit, New Jersey (Hybrid - 3 days onsite, 2 days remote) Candidate Preference: Local candidates or those willing to relocate to Summit, NJ Work Authorization: W2 Candidates Only Years of Experience: 6 years Must-Have Skills: Programming: Proficiency in Scala, Python, or Java Big Data: Experience with Spark, Hadoop, or MapR-based middleware services programming Preferred Skills: Cloud Computing: Exposure to cloud platforms (AWS, Azure, GCP, etc.) Containerization: Familiarity with Docker and Kubernetes Automation: Experience with Python-based automation Description: We are seeking a skilled Hadoop Engineer to join our team. In this role, you will leverage your programming expertise in Scala, Python, or Java to develop and maintain middleware services on Spark, Hadoop, or MapR platforms. You will also contribute to the design and implementation of data processing pipelines, ensuring efficient and scalable solutions. Responsibilities: Design, develop, and maintain middleware services using Spark, Hadoop, or MapR. Write and optimize code in Scala, Python, or Java. Implement data processing pipelines and workflows. Collaborate with cross-functional teams to gather requirements and deliver solutions. Troubleshoot and resolve issues related to data processing and middleware services. Stay updated on the latest Big Data technologies and best practices. Qualifications: 4 years of Software Engineering experience or equivalent demonstrated through one or a combination of the following: work experience, consulting experience, training, military experience, or education. Strong programming skills in Scala, Python, or Java. Hands-on experience with Spark, Hadoop, or MapR. Understanding of cloud computing concepts and technologies. Familiarity with Docker and Kubernetes is a plus. Experience with Python-based automation is a plus. Excellent communication and collaboration skills.