Get new jobs for this search by email

Job Summary: We are seeking a highly skilled and motivated Big Data Engineer to join our client's Big Data Platform team within the streaming domain. This role offers an exciting opportunity to work with large-scale data solutions that drive critical business decisions, including product design, advertising effectiveness, content discovery, and new market expansions. Our team values data as a core asset, leveraging it to enhance user experience, support advertisers, and empower content partners. We are looking for a technically proficient candidate who is eager to innovate and build cutting-edge data solutions.

Key Responsibilities:

• Design, develop, and optimize scalable data solutions.
• Collaborate with cross-functional teams to drive data-driven decision-making.
• Implement and maintain batch and real-time data processing frameworks.
• Ensure data integrity, security, and compliance with industry best practices.
• Enhance self-service data capabilities for internal stakeholders.

Basic Qualifications:

• Bachelor's degree in Computer Science, Information Systems, Software Engineering, or a related field, or equivalent work experience.
• Minimum of 3 years of experience in big data engineering, including modeling and developing large data pipelines.
• Proficiency in programming languages such as Scala, Java, and Python.
• Strong expertise in Hadoop ecosystem components, including Yarn and Resource Manager.
• Hands-on experience with distributed systems and batch processing technologies such as Apache Spark.
• Strong SQL skills for data exploration and analysis.
• Understanding of Software Development Lifecycle (SDLC) and best practices.

Preferred Qualifications:

• Experience with real-time data processing technologies like Apache Flink.
• Familiarity with CI/CD pipelines for streamlined development and deployment.
• Ability to design and develop user interfaces for self-service data access.
• Strong problem-solving skills and ability to bridge technical and non-technical teams.
• Experience in integrating complex systems and enhancing software development practices.