Big Data Engineer

Job Summary We are seeking a Big Data Engineer with strong Java skills and experience in AWS to join our team. The ideal candidate will have expertise in working with large data sets, ETL processes, and high-volume data collection applications. Experience with Spark (EMR and Glue), Spring Boot, and AWS services like S3 is essential. The team is building a new platform for Credit Card data, providing a great opportunity for impactful new development. Key Responsibilities • Design and implement data pipelines for high-volume data processing using Spark and AWS services. • Develop and maintain ETL processes and work with large datasets to ensure seamless data processing. • Build and optimize applications using Java and Spring Boot for scalability and performance. • Work with AWS services such as S3, EMR, and Glue to implement cloud-based solutions. • Collaborate within agile scrum teams to deliver platform development and enhancements. • Write efficient and maintainable code, focusing on scalability and performance. Required Qualifications • Strong experience in Java development with a software engineering skillset. • Experience working with large data sets, ETL, or high-volume data collection applications. • Proficiency in Spring Boot. • Experience with Spark or other large-scale data processing frameworks. • Solid experience with AWS, including S3, EMR, and/or Glue. • Proficiency in SQL and working with relational databases. Preferred Qualifications • Experience with Python or PySpark. • Experience with Data Lake architectures. • Experience with Credit Card application development. • Experience with Snowflake. • Knowledge of Terraform and GraphQL Education: Bachelors Degree