Insight Global
Sr. Data Engineer
Insight Global, Salt Lake City, Utah, United States, 84193
Our client is looking for a Senior Data Engineer to play a crucial role in the development, maintenance, and evolution of our data infrastructure. This position will focus on our Microsoft SQL Server environment, but experience with a variety of database technologies is highly valued. You will be responsible for designing, building, and optimizing robust and scalable ETL pipelines using SQL and Python, constructing and maintaining data marts, and ensuring the overall health and performance of our data warehouse architecture. This role requires a strong understanding of cloud architecture, advanced SQL and Python skills, a commitment to data quality and governance, and the ability to translate business needs into effective technical solutions. You will collaborate closely with stakeholders to gather requirements and contribute to the design of current and future data solutions.
Responsibilities:Collaborate directly with stakeholders to gather requirements and translate business needs into technical solutions for current and future data projects.Design, develop, and maintain robust and scalable ETL pipelines using SQL and Python to integrate data from various sources into our data warehouse.Design, develop, and maintain data integration services to the data warehouse as well as event handlingBuild and maintain data marts to support specific reporting and analytical needs.Optimize data warehouse and ETL processes for performance and efficiency.Contribute to the development and maintenance of our cloud-based data architecture.Implement and maintain data security measures to protect sensitive information.Ensure data quality, implement data governance practices, and maintain data lineage.Develop and implement unit and integration tests for ETL pipelines.Support and troubleshoot existing reporting solutions.Develop and maintain new reporting/dashboard solutions using tools like Power BI and Python libraries (e.g., matplotlib, seaborn).Support the expansion of our MLOps capabilities by leveraging your understanding of Machine Learning Operations.Utilize version control systems like Git to manage code effectively.Document processes and solutions clearly and concisely.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
5+ years of experience in data engineeringo SQL, Microsoft SQL Servero data warehousing, data modeling concepts, and dimensional modelingo data quality management, data governance, and data lineageo testing frameworks for data pipelinesPythono data manipulation(e.g., Pandas, NumPy)ETLo Glu in AWS is what they are currently usingo DBT Is the future stateOpen-Source softwareo (e.g., DBT, Airflow, Kubernetes)Solid understanding of cloud architecture and technologies (e.g., AWS S3, GCP BigQuery).Proficiency with Git or other version control systemsCollaboration tools Jira, Confluence
Nice to Have Skills & Experience
Relational database systems (e.g., PostgreSQL, MySQL, Oracle)CI/CD for data pipelinesBI & Data Visualization Tools- Power BI, Tableau
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Responsibilities:Collaborate directly with stakeholders to gather requirements and translate business needs into technical solutions for current and future data projects.Design, develop, and maintain robust and scalable ETL pipelines using SQL and Python to integrate data from various sources into our data warehouse.Design, develop, and maintain data integration services to the data warehouse as well as event handlingBuild and maintain data marts to support specific reporting and analytical needs.Optimize data warehouse and ETL processes for performance and efficiency.Contribute to the development and maintenance of our cloud-based data architecture.Implement and maintain data security measures to protect sensitive information.Ensure data quality, implement data governance practices, and maintain data lineage.Develop and implement unit and integration tests for ETL pipelines.Support and troubleshoot existing reporting solutions.Develop and maintain new reporting/dashboard solutions using tools like Power BI and Python libraries (e.g., matplotlib, seaborn).Support the expansion of our MLOps capabilities by leveraging your understanding of Machine Learning Operations.Utilize version control systems like Git to manage code effectively.Document processes and solutions clearly and concisely.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
5+ years of experience in data engineeringo SQL, Microsoft SQL Servero data warehousing, data modeling concepts, and dimensional modelingo data quality management, data governance, and data lineageo testing frameworks for data pipelinesPythono data manipulation(e.g., Pandas, NumPy)ETLo Glu in AWS is what they are currently usingo DBT Is the future stateOpen-Source softwareo (e.g., DBT, Airflow, Kubernetes)Solid understanding of cloud architecture and technologies (e.g., AWS S3, GCP BigQuery).Proficiency with Git or other version control systemsCollaboration tools Jira, Confluence
Nice to Have Skills & Experience
Relational database systems (e.g., PostgreSQL, MySQL, Oracle)CI/CD for data pipelinesBI & Data Visualization Tools- Power BI, Tableau
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.