CDW
Senior Data Engineer
CDW, Alloway, New Jersey, us, 08001
DescriptionBring your IT career and talents to CDW, where you can have a greater impact, be inspired by our mission and excited about your career and future. A Fortune 200 leader, we’re the driven professionals and technology experts companies turn to most to solve their IT challenges.CDW is a leading technology solutions provider to business, government, education and healthcare organisations in the United Kingdom, Canada, and the United States. Our fingerprints can be found on technology in workplaces of more than 250,000 companies: from start-ups to international conglomerates. With the breadth of products and services we offer, there is no request too big or too small.
CDW prides itself on being ‘People Who Get IT’ and ‘People who get People’. Our relationships are fuelled by our deep expertise and grounded in the CDW Way. Our empowering leadership makes things happen and inspires their teams to do the same. From the teammates beside us to the leaders who guide us, we move forward together. At CDW, you’ll work with people who inspire you. People with positive, success-driven attitudes who you will learn from and forge strong relationships with. Bring your best true self— and your best ideas—to CDW. Because diverse perspectives bring forth better problem solving—and better solutions for our customers on a rapidly evolving technology landscape.
Key DutiesCDW is constantly evolving our Data and technology landscape and are looking for a Snr Data Engineer & Architect to join a growing team to ingest, cleanse and model data into single source of truth, Kimball datasets, used for Business Intelligence reporting, machine learning and Data Science use cases.
Be a leader to other technology members and ensure best practices, standards and quality.Design and develop homogenous data repositories to deliver data led decision making.Ingest data from various sources, including on premise SQL databases, REST API’s, Apache Kafka streams, etc.Define and apply cleansing rules to the data to ensure meets quality expectations.Define and model data for its appropriate use including into single source of truth Kimball datasets, e.g. dimensions and facts.DevOps approach to software; create high quality code using traditional software practices, such as building, linting, unit and integration testing, repositories, CI/CD, peer reviews, etc.DevOps approach to support; monitor pipelines to ensure business critical data pipelines are processed meeting time constraint and data quality expectations (including implementing reactive changes where applicable).Drives and Integrates into the data team’s WOW, including backlog refinement, sprint planning, demonstrations, and retrospectives, including translation of user requirements into technical requirements including complexity estimation, implement into sprint cycles, collaboration into process improvement, etc.Based on requirements, perform ad-hoc analysis of structured and unstructured data across multiple data sources to inform solution design.Document datasets in data catalogue, including ownership, stewardship, dictionaries, glossaries, lineage, sensitivity, etc. Job Description File Name: Job Description Template V2 pg. 2 Classification: Public Information Owner: Coworker Services Version: 2.0Ownership of Work Items and works with data owners / stewards to ensure high quality, aligned deliveries, and compliance with legislation, such as GDPR, e.g. PII vs Non-PII, data retention, etc. • Document solution design in wiki.Knowledge and experienceAt least 7 years as an Engineer in a Data FieldAt least 5 years of Architecture and modellingStrong leadership skillsStrong Azure data skills, including:- Azure Data Factory V2- Azure Data Lake Storage V2- Azure Databricks- Azure Function Apps& Logic Apps o Azure Stream Analytics- Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell)Strong PySpark, Delta Lake, Unity Catalog and Python skills. o Includes ability to write unit and integration tests in Python with unittest, pytest, etc.Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc.Strong repositories, CI/CD skills.Strong knowledge of Kimball data modelling, such as star schema, snowflake, etc.Strong SQL skills.Strong data analysis skills.Excellent written and verbal communication skillsA demonstrable track record of getting stuff done whilst managing competing pressures and deadlines and retaining an eye for detail and quality.A passion for technology and its ability to have a positive impact on business.Personal AttributesNatural leader and motivated to help othersSelf-driven, doesn’t require micromanagementOrganised and structuredComfortable in fast-paced environments with shifting & ambiguous requirementsPassionate about both process and technology and the impact they can have on business and our customersArticulate and credible • Quality and detail orientatedPositive attitude and influence on othersFast learner and able to adapt to new technology and keep abreast of current industry trends and practiceExcellent communicator in all forms to key stakeholdersExcellent organisation and time management skillsWho we are:CDW is a leading technology solutions provider to business, government, education and healthcare organizations across the globe. Our fingerprints can be found on technology in workplaces of more than 250,000 companies; from fresh-faced start-ups to international conglomerates. With the breadth of products and services we offer, there is no request too big or too small.What you can expect from us: Culture, coworkers, careers.CDW is not only the People Who Get IT but the People who get People. Our relationships are fueled by our deep expertise and grounded in the CDW Way. Our empowering leadership makes things happen and inspires their teams to do the same. From the teammates beside us to the leaders who guide us, we move forward together. At CDW, you’ll work with people who inspire you. People with positive, success-driven attitudes who you will learn from and forge strong relationships with. Bring your best true self—and your best ideas—to CDW. Because diverse perspectives bring forth better problem solving—and better solutions for our customers on a rapidly evolving technology landscape.
CDW prides itself on being ‘People Who Get IT’ and ‘People who get People’. Our relationships are fuelled by our deep expertise and grounded in the CDW Way. Our empowering leadership makes things happen and inspires their teams to do the same. From the teammates beside us to the leaders who guide us, we move forward together. At CDW, you’ll work with people who inspire you. People with positive, success-driven attitudes who you will learn from and forge strong relationships with. Bring your best true self— and your best ideas—to CDW. Because diverse perspectives bring forth better problem solving—and better solutions for our customers on a rapidly evolving technology landscape.
Key DutiesCDW is constantly evolving our Data and technology landscape and are looking for a Snr Data Engineer & Architect to join a growing team to ingest, cleanse and model data into single source of truth, Kimball datasets, used for Business Intelligence reporting, machine learning and Data Science use cases.
Be a leader to other technology members and ensure best practices, standards and quality.Design and develop homogenous data repositories to deliver data led decision making.Ingest data from various sources, including on premise SQL databases, REST API’s, Apache Kafka streams, etc.Define and apply cleansing rules to the data to ensure meets quality expectations.Define and model data for its appropriate use including into single source of truth Kimball datasets, e.g. dimensions and facts.DevOps approach to software; create high quality code using traditional software practices, such as building, linting, unit and integration testing, repositories, CI/CD, peer reviews, etc.DevOps approach to support; monitor pipelines to ensure business critical data pipelines are processed meeting time constraint and data quality expectations (including implementing reactive changes where applicable).Drives and Integrates into the data team’s WOW, including backlog refinement, sprint planning, demonstrations, and retrospectives, including translation of user requirements into technical requirements including complexity estimation, implement into sprint cycles, collaboration into process improvement, etc.Based on requirements, perform ad-hoc analysis of structured and unstructured data across multiple data sources to inform solution design.Document datasets in data catalogue, including ownership, stewardship, dictionaries, glossaries, lineage, sensitivity, etc. Job Description File Name: Job Description Template V2 pg. 2 Classification: Public Information Owner: Coworker Services Version: 2.0Ownership of Work Items and works with data owners / stewards to ensure high quality, aligned deliveries, and compliance with legislation, such as GDPR, e.g. PII vs Non-PII, data retention, etc. • Document solution design in wiki.Knowledge and experienceAt least 7 years as an Engineer in a Data FieldAt least 5 years of Architecture and modellingStrong leadership skillsStrong Azure data skills, including:- Azure Data Factory V2- Azure Data Lake Storage V2- Azure Databricks- Azure Function Apps& Logic Apps o Azure Stream Analytics- Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell)Strong PySpark, Delta Lake, Unity Catalog and Python skills. o Includes ability to write unit and integration tests in Python with unittest, pytest, etc.Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc.Strong repositories, CI/CD skills.Strong knowledge of Kimball data modelling, such as star schema, snowflake, etc.Strong SQL skills.Strong data analysis skills.Excellent written and verbal communication skillsA demonstrable track record of getting stuff done whilst managing competing pressures and deadlines and retaining an eye for detail and quality.A passion for technology and its ability to have a positive impact on business.Personal AttributesNatural leader and motivated to help othersSelf-driven, doesn’t require micromanagementOrganised and structuredComfortable in fast-paced environments with shifting & ambiguous requirementsPassionate about both process and technology and the impact they can have on business and our customersArticulate and credible • Quality and detail orientatedPositive attitude and influence on othersFast learner and able to adapt to new technology and keep abreast of current industry trends and practiceExcellent communicator in all forms to key stakeholdersExcellent organisation and time management skillsWho we are:CDW is a leading technology solutions provider to business, government, education and healthcare organizations across the globe. Our fingerprints can be found on technology in workplaces of more than 250,000 companies; from fresh-faced start-ups to international conglomerates. With the breadth of products and services we offer, there is no request too big or too small.What you can expect from us: Culture, coworkers, careers.CDW is not only the People Who Get IT but the People who get People. Our relationships are fueled by our deep expertise and grounded in the CDW Way. Our empowering leadership makes things happen and inspires their teams to do the same. From the teammates beside us to the leaders who guide us, we move forward together. At CDW, you’ll work with people who inspire you. People with positive, success-driven attitudes who you will learn from and forge strong relationships with. Bring your best true self—and your best ideas—to CDW. Because diverse perspectives bring forth better problem solving—and better solutions for our customers on a rapidly evolving technology landscape.