1872 Consulting
Data Engineer
1872 Consulting, Chicago, Illinois, United States, 60290
Data EngineerChicago, Dallas or NY - hybrid WFH
Why This Role Is ValuableThis person will sit on a more senior Data Engineering team, and have ample opportunity to learn modern data engineering technologies such as Spark/PySpark and working in modern cloud environments, with cloud DWs.
While you must have the core ETL/Data Engineering experience, we want more junior engineers who are eager to learn and grow in their careers.
What you'll be doing
Design, develop, and launch extremely efficient and reliable data pipelines to move and transform data to enable downstream consumption and insightsCollaborate with other data engineers, analysts, product managers, and customers to implement technical solutions to business problemsSupport the development process by participating in regular scrum activities, code review, and architectural reviewsImplement DevOps patterns in conjunction with our SREsDiagnose and solve issues in existing data pipelines, and use learnings to build their successorsSkills we're seeking
2+ years of experience with Data Engineering, Data Analysis and/or ETL DevelopmentMust have at least 1 year of experience with Data Engineering (building data pipelines) OR ETL Development experience, as data engineering is the focus of this roleMust have strong SQL experienceMust have at least some experience working in cloud environments, ideally AzureNice to have experience
Spark/PySpark experiencePython experienceExperience with the issues of performance, availability, scalability, reliability, and maintainability of data pipelines
Why This Role Is ValuableThis person will sit on a more senior Data Engineering team, and have ample opportunity to learn modern data engineering technologies such as Spark/PySpark and working in modern cloud environments, with cloud DWs.
While you must have the core ETL/Data Engineering experience, we want more junior engineers who are eager to learn and grow in their careers.
What you'll be doing
Design, develop, and launch extremely efficient and reliable data pipelines to move and transform data to enable downstream consumption and insightsCollaborate with other data engineers, analysts, product managers, and customers to implement technical solutions to business problemsSupport the development process by participating in regular scrum activities, code review, and architectural reviewsImplement DevOps patterns in conjunction with our SREsDiagnose and solve issues in existing data pipelines, and use learnings to build their successorsSkills we're seeking
2+ years of experience with Data Engineering, Data Analysis and/or ETL DevelopmentMust have at least 1 year of experience with Data Engineering (building data pipelines) OR ETL Development experience, as data engineering is the focus of this roleMust have strong SQL experienceMust have at least some experience working in cloud environments, ideally AzureNice to have experience
Spark/PySpark experiencePython experienceExperience with the issues of performance, availability, scalability, reliability, and maintainability of data pipelines