Our large digital transformation company is seeking a talented and experienced Data Engineer to join our team, specializing in Databricks and the financial industry. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and infrastructure through data bricks to support financial clients’ data-driven initiatives.
Key Responsibilities Include:
- Architect and design end-to-end data solutions using Databricks to process and analyze large-scale financial data.
- Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
- Develop and implement data integration, transformation, and validation processes to ensure data accuracy and consistency.
- Lead the development and optimization of ETL pipelines to ingest data from various sources into data lakes and warehouses.
- Ensure the reliability, performance, and scalability of data architectures.
Must haves:
7+ years in data architecture helping to design solutions within financial industry
Strong proficiency in SQL, Python, and Spark
Deep understanding of data warehousing concepts and technologies (e.g., Snowflake, Redshift).
Databricks Certified