JobRialto
Data Engineer
JobRialto, Richmond, Virginia, United States, 23214
Overview :
We are seeking a skilled Data Engineer to join our team, focusing on ETL support for credit card processing and data products. In this role, you will be responsible for building and maintaining data pipelines, batch processing applications, and supporting production environments. The ideal candidate will have strong expertise in Big Data engineering, particularly in ETL development, and will work closely with Product Owners to ensure efficient requirement gathering, code maintenance, and testing.
Key Responsibilities:
•Build and manage robust data pipelines and ETL processes for credit card data.
•Leverage technologies such as PySpark and AWS services, including Glue, S3, EMR, and Lambda, to support batch processing applications.
•Use Snowflake and SQL to build and maintain flexible, scalable data storage solutions.
•Collaborate with Product Owners to gather requirements, maintain and test code for production-ready data solutions.
•Provide production support for data systems and applications.
•Ensure system reliability and scalability for data products used across the enterprise.
Required Skills and Experience:
•Strong expertise in Big Data Engineering with hands-on experience in ETL processes.
•Proficiency in PySpark, AWS (Glue, S3, EMR, Lambda), and SQL.
•Familiarity with Snowflake or similar data warehousing solutions.
•Experience in building ETL pipelines and batch processing applications.
•Proven ability to work in an enterprise environment with at least 2 years of experience in building data products.
•Excellent communication skills to work with cross-functional teams and Product Owners.
•Strong problem-solving skills and ability to provide production support.
Preferred Qualifications:
•Experience working in the credit card or financial services industry.
•Familiarity with testing frameworks and methodologies for data pipelines.
Education:
Bachelors Degree
We are seeking a skilled Data Engineer to join our team, focusing on ETL support for credit card processing and data products. In this role, you will be responsible for building and maintaining data pipelines, batch processing applications, and supporting production environments. The ideal candidate will have strong expertise in Big Data engineering, particularly in ETL development, and will work closely with Product Owners to ensure efficient requirement gathering, code maintenance, and testing.
Key Responsibilities:
•Build and manage robust data pipelines and ETL processes for credit card data.
•Leverage technologies such as PySpark and AWS services, including Glue, S3, EMR, and Lambda, to support batch processing applications.
•Use Snowflake and SQL to build and maintain flexible, scalable data storage solutions.
•Collaborate with Product Owners to gather requirements, maintain and test code for production-ready data solutions.
•Provide production support for data systems and applications.
•Ensure system reliability and scalability for data products used across the enterprise.
Required Skills and Experience:
•Strong expertise in Big Data Engineering with hands-on experience in ETL processes.
•Proficiency in PySpark, AWS (Glue, S3, EMR, Lambda), and SQL.
•Familiarity with Snowflake or similar data warehousing solutions.
•Experience in building ETL pipelines and batch processing applications.
•Proven ability to work in an enterprise environment with at least 2 years of experience in building data products.
•Excellent communication skills to work with cross-functional teams and Product Owners.
•Strong problem-solving skills and ability to provide production support.
Preferred Qualifications:
•Experience working in the credit card or financial services industry.
•Familiarity with testing frameworks and methodologies for data pipelines.
Education:
Bachelors Degree