JobRialto
Lead Data Engineer - AWS, Python, SQL
JobRialto, Chicago, Illinois, United States, 60290
Job Summary
The Lead Data Engineer will be responsible for supporting critical business initiatives within a Fortune 100 Financial Services client. This role involves working closely with product owners, business units, finance, and technology teams to optimize data movement, transformation, and architecture. The Lead Data Engineer will also contribute to best practices in data engineering while leveraging cutting-edge technologies and cloud computing platforms.
Key Responsibilities
• Partner with product owners, peers, and end-users to understand business requirements, identify risks/issues, and escalate as necessary
• Serve as the intersection between lines of business, finance, and technology, balancing multiple perspectives to deliver optimized engineering solutions
• Provide technical guidance on the business implications of application development projects
• Utilize programming skills in open-source languages, including Python and SQL, with expertise in Spark frameworks
• Manage multiple responsibilities in an unstructured environment, empowering innovation and problem-solving through research and development of new technologies
• Develop, maintain, and optimize big data solutions while ensuring smooth data transformation and migration efforts
• Implement test automation to ensure high data quality and system reliability
Required Qualifications
• 8 - 10+ years of related experience in data engineering and management
• Strong expertise with open-source languages, including Python and SQL, on Spark frameworks
• Experience with data projects involving querying databases and transforming legacy data platforms to modern streaming solutions
• Solid understanding of cloud computing, preferably AWS, including services such as Glue, EMR/EC2, DynamoDB, and Lambda functions
• Background in test automation
Preferred Qualifications
• Experience in the Financial Services industry
Certifications
• Bachelor's degree in Computer Science or related field
• Advanced certifications in cloud computing or data engineering are a plus
Education:
Bachelors Degree
The Lead Data Engineer will be responsible for supporting critical business initiatives within a Fortune 100 Financial Services client. This role involves working closely with product owners, business units, finance, and technology teams to optimize data movement, transformation, and architecture. The Lead Data Engineer will also contribute to best practices in data engineering while leveraging cutting-edge technologies and cloud computing platforms.
Key Responsibilities
• Partner with product owners, peers, and end-users to understand business requirements, identify risks/issues, and escalate as necessary
• Serve as the intersection between lines of business, finance, and technology, balancing multiple perspectives to deliver optimized engineering solutions
• Provide technical guidance on the business implications of application development projects
• Utilize programming skills in open-source languages, including Python and SQL, with expertise in Spark frameworks
• Manage multiple responsibilities in an unstructured environment, empowering innovation and problem-solving through research and development of new technologies
• Develop, maintain, and optimize big data solutions while ensuring smooth data transformation and migration efforts
• Implement test automation to ensure high data quality and system reliability
Required Qualifications
• 8 - 10+ years of related experience in data engineering and management
• Strong expertise with open-source languages, including Python and SQL, on Spark frameworks
• Experience with data projects involving querying databases and transforming legacy data platforms to modern streaming solutions
• Solid understanding of cloud computing, preferably AWS, including services such as Glue, EMR/EC2, DynamoDB, and Lambda functions
• Background in test automation
Preferred Qualifications
• Experience in the Financial Services industry
Certifications
• Bachelor's degree in Computer Science or related field
• Advanced certifications in cloud computing or data engineering are a plus
Education:
Bachelors Degree