Diverse Lynx
Java Spark Developer
Diverse Lynx, Plano, Texas, us, 75086
Java Spark Developer
Location : Plano, Tx and Wilmington, DE
Job Description
Must Have skill :
Java Spark and AWS
Snowflake - Preferably Good knowledge/ Experience.Design, develop, and maintain scalable data pipelines using Apache Spark and Java.Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.Optimize and tune data processing jobs for performance and cost-efficiency.Ensure data quality, integrity, and security across all data pipelines and storage solutions.Develop and maintain data models, schemas, and documentation.Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. SnowflakeExperience with SQL and NoSQL databases.
CICd/ Jules /Spinnaker
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location : Plano, Tx and Wilmington, DE
Job Description
Must Have skill :
Java Spark and AWS
Snowflake - Preferably Good knowledge/ Experience.Design, develop, and maintain scalable data pipelines using Apache Spark and Java.Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.Optimize and tune data processing jobs for performance and cost-efficiency.Ensure data quality, integrity, and security across all data pipelines and storage solutions.Develop and maintain data models, schemas, and documentation.Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. SnowflakeExperience with SQL and NoSQL databases.
CICd/ Jules /Spinnaker
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.