RIT Solutions, Inc.
Lead Data Engineer
RIT Solutions, Inc., Tampa, Florida, us, 33646
Lead Data EngineerLocation-
Remote (EST)
Contract:
6+ months Ongoing (possible contract to hire/must be eligible for conversion)Summary:As a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be responsible for data integration, migration, and analysis using a variety of Microsoft technologies. This role requires a deep understanding
of Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL and Python . You will work closely with the Data Lead and Technical Analyst to translate business requirements into technical solutions and ensure the seamless flow of data across our systems.
Key Responsibilities:* Lead Data Engineer will design, develop, and maintain data pipelines using Azure Data Factory, Logic Apps, and Azure Service Bus* Implement and manage Databricks for advanced data processing and analytics* Develop complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL)* Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications* Ensure data quality and integrity across various data sources and systems* Manage data integrations and migrations between diverse systems, ensuring minimal disruption to business operations* As a Lead Data Engineer, you will utilize Azure CI/CD pipelines for continuous integration and delivery of data solutions* Create and maintain data workflows using Power Automate* Conduct data analysis to support business decision-making processes* Work independently and as part of a team to deliver high-quality data solutions* Communicate effectively with stakeholders to understand their data needs and provide technical guidance
Remote (EST)
Contract:
6+ months Ongoing (possible contract to hire/must be eligible for conversion)Summary:As a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be responsible for data integration, migration, and analysis using a variety of Microsoft technologies. This role requires a deep understanding
of Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL and Python . You will work closely with the Data Lead and Technical Analyst to translate business requirements into technical solutions and ensure the seamless flow of data across our systems.
Key Responsibilities:* Lead Data Engineer will design, develop, and maintain data pipelines using Azure Data Factory, Logic Apps, and Azure Service Bus* Implement and manage Databricks for advanced data processing and analytics* Develop complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL)* Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications* Ensure data quality and integrity across various data sources and systems* Manage data integrations and migrations between diverse systems, ensuring minimal disruption to business operations* As a Lead Data Engineer, you will utilize Azure CI/CD pipelines for continuous integration and delivery of data solutions* Create and maintain data workflows using Power Automate* Conduct data analysis to support business decision-making processes* Work independently and as part of a team to deliver high-quality data solutions* Communicate effectively with stakeholders to understand their data needs and provide technical guidance