Insight Global
Sr. Data Engineer
Insight Global, Seattle, Washington, us, 98127
Job Description
This person will join the Store and Supply Chain Team. Originally, all of the Store and Supply Chain data was stored in an old, specialized data warehouse. These two data engineers will be responsible for moving their data into a new UC (unity catalog) that is well-governed and compliant. This position is responsible for design, development, testing and support for data pipelines to enable continuous data processing for data exploration, data preparation and real-time business analytics.
Demonstrate deep knowledge the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline and technology capabilities
Build fault tolerant, self-healing, adaptive and highly accurate data computational pipelines
Provide consultation and lead implementation of complex programs
Develop and maintain documentation relating to all assigned systems and projects
Tune queries running over billion of rows of data running in a distributed query engine
Perform root cause analysis to identify permanent resolutions to software or business process issue
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
7+ Years of experience as a Data Engineer with the following technologies
Strong/expert Spark (PySpark) Using DataBricks
Hands on data pipeline development, ingest patterns in Azure
Orchestration tools- Airflow
SQL
Denormalized Data modelling for big data systems
Strong analytical and design skills
Bachelors degree in computer science, management information systems, or related discipline, or equivalent work experience
Version Control GIT /CICD Power BI/Tableau experience
Alteryx experience
ML/AI experience null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
This person will join the Store and Supply Chain Team. Originally, all of the Store and Supply Chain data was stored in an old, specialized data warehouse. These two data engineers will be responsible for moving their data into a new UC (unity catalog) that is well-governed and compliant. This position is responsible for design, development, testing and support for data pipelines to enable continuous data processing for data exploration, data preparation and real-time business analytics.
Demonstrate deep knowledge the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline and technology capabilities
Build fault tolerant, self-healing, adaptive and highly accurate data computational pipelines
Provide consultation and lead implementation of complex programs
Develop and maintain documentation relating to all assigned systems and projects
Tune queries running over billion of rows of data running in a distributed query engine
Perform root cause analysis to identify permanent resolutions to software or business process issue
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
7+ Years of experience as a Data Engineer with the following technologies
Strong/expert Spark (PySpark) Using DataBricks
Hands on data pipeline development, ingest patterns in Azure
Orchestration tools- Airflow
SQL
Denormalized Data modelling for big data systems
Strong analytical and design skills
Bachelors degree in computer science, management information systems, or related discipline, or equivalent work experience
Version Control GIT /CICD Power BI/Tableau experience
Alteryx experience
ML/AI experience null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.