Insight Global
Data Engineering Advisor
Insight Global, Spring, Texas, us, 77391
An Oil & Gas customer of Insight Global is looking for a Data Engineering Advisor to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually.
Responsibilities: Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data. Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations. Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines. Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts. Employ programming languages like Java or Python for automation and API integration tasks. Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models. Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture. Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Oil and Gas/Midstream industry experience
Heavy Data Transformation experience 12+ years of IT experience as a Data Engineer, Data Architect, or Software Developer
In-depth knowledge of Azure cloud services, relational database design principles, data warehousing, performance tuning, and optimization
Strong analytic skills related to working with both structured and unstructured datasets
High level proficiency in T-SQL, ADF Pipelines, SSIS packages, Lift and Shift of existing On-premises processes, database design principles, data modeling and data warehousing
Experience using/setting up Azure DevOps integration with cloud services and setting up CI/CD processes
Understanding of performance analysis and tuning activities to ensure optimal database performance
Excellent communication skills with the ability to interact with developers supporting requirements gathering
Responsibilities: Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data. Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations. Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines. Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts. Employ programming languages like Java or Python for automation and API integration tasks. Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models. Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture. Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Oil and Gas/Midstream industry experience
Heavy Data Transformation experience 12+ years of IT experience as a Data Engineer, Data Architect, or Software Developer
In-depth knowledge of Azure cloud services, relational database design principles, data warehousing, performance tuning, and optimization
Strong analytic skills related to working with both structured and unstructured datasets
High level proficiency in T-SQL, ADF Pipelines, SSIS packages, Lift and Shift of existing On-premises processes, database design principles, data modeling and data warehousing
Experience using/setting up Azure DevOps integration with cloud services and setting up CI/CD processes
Understanding of performance analysis and tuning activities to ensure optimal database performance
Excellent communication skills with the ability to interact with developers supporting requirements gathering