KION Group
Senior / Principal Backend Engineer – Data Platform (Evergreen) (Open)
KION Group, Atlanta, Georgia, United States, 30383
About Us
At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform, providing abstractions that empower other teams to seamlessly extend the platform.
Role Overview
We are seeking dynamic and highly skilled Senior and Principal level Data Engineers to design and build the core foundation of our Enterprise Data Platform. This role demands engineers who not only possess a profound understanding of the data engineering landscape but have built core foundations in the past. The ideal candidates will contribute significantly to the platform development while actively shaping the future of our data ecosystem.
What we offer:
Career DevelopmentCompetitive Compensation and BenefitsPay TransparencyGlobal Opportunities
Dematic provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
What We Are Looking For:
Responsibilities:
Architect, design and develop core data platform components with a microservices architecture, abstracting platform, and infrastructure intricacies.Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.Design and develop connector frameworks and modern connectors to source data from disparate applications both on-prem and cloud.Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices.Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.Design and develop advanced analytics and machine learning capabilities on the data platform.Design and develop observability and data governance frameworks and practices.Solid experience deployment and release cycles of data assets, ensuring a robust and scalable platform.Stay up to date with the latest data engineering trends, technologies, and best practices.
Tasks and Qualifications:
Requirements:
10+ years of experience for senior, and 15+ for principal, of proven experience in modern cloud data engineering, data architectures, data warehousing, and software engineering.Expertise in architecting, designing, and building end to end data platforms using Databricks.Expertise with table formats Delta Lake (preferable) or Apache Iceberg.Solid experience building data platforms in GCP environment.Solid experience designing and developing modular, distributed data platform components with a microservices architecture. Strong experience with Docker, Kubernetes, APIs is needed.Proficiency in data engineering tools and technologies - SQL, Python, Spark, DBT, Airflow, Kafka.Solid experience implementing data lineage, data quality and data observability for big data workflows.Strong experience with modern data modeling, data architecture, and data governance principles.Excellent experience with DataOps principles and test automation.Excellent experience with observability tools - Grafana and Datadog.Applicants must be authorized to work for any employer in the US without visa requirements. This position is not eligible for employment visa sponsorship, now or in the future.
Nice to have:
Experience with Data Mesh architecture.Experience building Semantic layers for data platforms.Experience building scalable IoT architectures.
#J-18808-Ljbffr
At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform, providing abstractions that empower other teams to seamlessly extend the platform.
Role Overview
We are seeking dynamic and highly skilled Senior and Principal level Data Engineers to design and build the core foundation of our Enterprise Data Platform. This role demands engineers who not only possess a profound understanding of the data engineering landscape but have built core foundations in the past. The ideal candidates will contribute significantly to the platform development while actively shaping the future of our data ecosystem.
What we offer:
Career DevelopmentCompetitive Compensation and BenefitsPay TransparencyGlobal Opportunities
Dematic provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
What We Are Looking For:
Responsibilities:
Architect, design and develop core data platform components with a microservices architecture, abstracting platform, and infrastructure intricacies.Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.Design and develop connector frameworks and modern connectors to source data from disparate applications both on-prem and cloud.Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices.Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.Design and develop advanced analytics and machine learning capabilities on the data platform.Design and develop observability and data governance frameworks and practices.Solid experience deployment and release cycles of data assets, ensuring a robust and scalable platform.Stay up to date with the latest data engineering trends, technologies, and best practices.
Tasks and Qualifications:
Requirements:
10+ years of experience for senior, and 15+ for principal, of proven experience in modern cloud data engineering, data architectures, data warehousing, and software engineering.Expertise in architecting, designing, and building end to end data platforms using Databricks.Expertise with table formats Delta Lake (preferable) or Apache Iceberg.Solid experience building data platforms in GCP environment.Solid experience designing and developing modular, distributed data platform components with a microservices architecture. Strong experience with Docker, Kubernetes, APIs is needed.Proficiency in data engineering tools and technologies - SQL, Python, Spark, DBT, Airflow, Kafka.Solid experience implementing data lineage, data quality and data observability for big data workflows.Strong experience with modern data modeling, data architecture, and data governance principles.Excellent experience with DataOps principles and test automation.Excellent experience with observability tools - Grafana and Datadog.Applicants must be authorized to work for any employer in the US without visa requirements. This position is not eligible for employment visa sponsorship, now or in the future.
Nice to have:
Experience with Data Mesh architecture.Experience building Semantic layers for data platforms.Experience building scalable IoT architectures.
#J-18808-Ljbffr