Dice
Staff Data Engineer / Multimodal AI
Dice, Chicago, Illinois, United States, 60290
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Motion Recruitment Partners, LLC, is seeking the following. Apply via Dice today!
We are looking for a Staff Data Engineer to join one of the 100 Best Companies to Work For, with offices in the Chicagoland area and remote flexibility, on a full-time basis. This leading supplier of maintenance, repair, and operating products for businesses and a wide range of industries across the globe has a focus on sustainability, social responsibility, and community engagement, serving more than 4.5 million customers worldwide.
As a Staff Data Engineer, you will help the team by ingesting flat files and multimodal files like PDFs, videos, voice recordings, and images to help improve their AI/ML platform that uses LLM technologies. This platform will help how the organization is servicing their various customers. In this role, you'll be contributing to ongoing architecture, development, and mentoring junior engineers. The ideal candidate will have a strong background in data engineering, with a focus on Databricks, and have experience implementing real-time streaming technologies. Having experience with IaC will be an added bonus.
Required Skills & ExperienceAs the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.Design and implement technical solutions and processes to ensure data reliability and accuracy.Develop data models and mappings and build new data assets required by users. Perform exploratory data analysis on existing products and datasets.Educate data engineering teams in adopting new data patterns and tools.Function as SME within this area when engaging with our AI, Platform, and Business Analytics teams to build useful pipelines and data assets.
Desired Skills & ExperienceExperience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads.Experience orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi.Experience prepping structured and unstructured data for data science models.Experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or Windows shell is preferable.Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD.Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB.Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking and matching.
The OfferBonus eligible
You will receive the following benefits:
Medical, dental, vision, and life insurance plansPaid time off (PTO) and 6 company holidays per yearAutomatic 6% 401(k) company contribution each pay periodEmployee discounts, parental leave, 3:1 match on donations and tuition reimbursementA comprehensive set of emotional, financial, physical and social wellbeing programs
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
Staff Data Engineer / Multimodal AI
#J-18808-Ljbffr
We are looking for a Staff Data Engineer to join one of the 100 Best Companies to Work For, with offices in the Chicagoland area and remote flexibility, on a full-time basis. This leading supplier of maintenance, repair, and operating products for businesses and a wide range of industries across the globe has a focus on sustainability, social responsibility, and community engagement, serving more than 4.5 million customers worldwide.
As a Staff Data Engineer, you will help the team by ingesting flat files and multimodal files like PDFs, videos, voice recordings, and images to help improve their AI/ML platform that uses LLM technologies. This platform will help how the organization is servicing their various customers. In this role, you'll be contributing to ongoing architecture, development, and mentoring junior engineers. The ideal candidate will have a strong background in data engineering, with a focus on Databricks, and have experience implementing real-time streaming technologies. Having experience with IaC will be an added bonus.
Required Skills & ExperienceAs the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.Design and implement technical solutions and processes to ensure data reliability and accuracy.Develop data models and mappings and build new data assets required by users. Perform exploratory data analysis on existing products and datasets.Educate data engineering teams in adopting new data patterns and tools.Function as SME within this area when engaging with our AI, Platform, and Business Analytics teams to build useful pipelines and data assets.
Desired Skills & ExperienceExperience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads.Experience orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi.Experience prepping structured and unstructured data for data science models.Experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or Windows shell is preferable.Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD.Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB.Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking and matching.
The OfferBonus eligible
You will receive the following benefits:
Medical, dental, vision, and life insurance plansPaid time off (PTO) and 6 company holidays per yearAutomatic 6% 401(k) company contribution each pay periodEmployee discounts, parental leave, 3:1 match on donations and tuition reimbursementA comprehensive set of emotional, financial, physical and social wellbeing programs
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
Staff Data Engineer / Multimodal AI
#J-18808-Ljbffr