Senior Data Engineer Job at QUANTEAM - North America in Houston

As the founding entity of RAINBOW PARTNERS, Quanteam is a consulting firm specializing in the fields of Banking, Finance, and Financial Services. Guided by our core values of closeness, teamwork, diversity, and excellence, our team of 1,000 expert consultants, representing 35 different nationalities, collaborates across 10 international offices: Paris, Lyon, New York, Montreal, London, Brussels, Geneva, Lisbon, Porto and Casablanca. About the Role Quanteam, a consulting firm specializing in technology and financial services, is looking for a Senior Data Engineer/Architect to join a strategic project with one of our clients, a major player in the energy sector. This opportunity is ideal for someone passionate about building cutting-edge data platforms and looking to play a pivotal role in redefining how data is managed, governed, and leveraged in a critical industry. Key Responsibilities Data Platform Development: Design and implement scalable data ingestion pipelines to structure and expose data for internal business users. Collaboration: Work closely with Business Analysts and internal teams to understand business challenges and translate them into technical solutions. Code Excellence: Develop modular, maintainable code, ensure high test coverage through automated testing, and participate in peer code reviews. Data Management: Address challenges related to distributed data ingestion (Spark), high-volume data handling, and SQL optimization. Cloud Integration: Lead the development of cloud-native solutions, with a strong preference for AWS (S3, Lambda, DynamoDB) and Azure DevOps. Governance and Quality: Contribute to the deployment of data governance frameworks to ensure the accuracy and reliability of data systems. Technical Skills Strong expertise in Python development (Software Engineering background preferred). Proven experience with distributed data systems (e.g., Spark, Databricks). Proficiency in SQL, particularly in optimization and performance tuning. Advanced understanding of cloud platforms, particularly AWS (S3, Lambda, DynamoDB). Familiarity with Git, CI/CD pipelines, and Azure DevOps. Experience managing large-scale referential data and ensuring its integrity. Preferred Qualifications Senior-level experience in Data Engineering or Data Architecture. Exposure to large-scale data platforms and performance-driven development. Commodities experience is not mandatory but would be a bonus. If you are a Senior Data Engineer/Architect with expertise in Python, distributed systems, and cloud technologies, we invite you to contribute to this exciting mission at the intersection of energy and technology