Tbwa Chiat/Day Inc
Software Engineer - Full Stack Data Engineer Houston, TX
Tbwa Chiat/Day Inc, Houston, Texas, United States, 77246
Software Engineer - Full Stack Data Engineer
Houston, TXCompany Introduction
At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up and the wisdom of seasoned experts, Bot Auto boasts a team that has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create miracles and propel the future of transportation. Join us and transform your dreams into reality.We are looking for a skilled and versatile Full Stack Data Engineer to join our team. This unique role is ideal for candidates who bring a strong foundation in both full stack development and data engineering. As a Full Stack Data Engineer, you’ll play a key role in advancing our autonomous driving data workflows, building high-performance internal tools, and developing our hybrid-Cloud data platform. Your work will span from developing web-based interfaces and dashboards to architecting robust data storage, extraction, and transformation pipelines.Key Responsibilities
Full Stack Data Platform:
Design and develop full-stack solutions, including web applications and dashboards, to support data monitoring, visualization, and flow management across autonomous driving data workflows.Collaborate with the infrastructure team to deploy and manage the data platform across hybrid-cloud solutions, utilizing both cloud-native compute services and on-premises data centers.Architect systems with high availability and elasticity by applying principles of stateful and stateless microservices, event queuing, caching strategies, load balancing, and API gateways.Data Engineering:
Build and maintain high-performance data collection pipelines that facilitate seamless data transfer from autonomous systems to both cloud and on-premises environments.Develop robust data ingestion pipelines that pull from CoreDB, external APIs, autonomous driving datasets, and streaming sources, integrating data efficiently into our Data Lake.Architect and optimize large-scale data storage solutions, ensuring efficient, scalable data management within our hybrid-cloud infrastructure.Analytical Solutions:
Create intuitive, user-friendly dashboards and analytics tools that empower executives, algorithm teams, and operations to access actionable insights and data-driven decision-making.Construct and maintain the Data Lakehouse and data visualization dashboards, supporting real-time analytics for strategic decision-making.Cross-functional Collaboration:
Work closely with cross-functional teams to deploy and integrate solutions that enhance the efficiency and effectiveness of data processes across the autonomous driving platform.Support the development of scalable ETL processes and transformation pipelines to provide timely analytics, reporting, and insights across teams.Qualifications
Required :Bachelor's degree in Computer Science, Engineering, or related field.Proven experience in software engineering with a focus on modern web technologies.Strong proficiency in React, Typescript, and CSS. Solid understanding of software architecture, data modeling, and database management.Strong with databases such as MySQL and Postgres, with experience in designing and managing them for data-driven applications.Experience with cloud platforms (AWS, GCP, or Azure) and hybrid-Cloud solutions.Experience with ETL processes, data transformation, and handling large datasets efficiently with distributed data processing engines such as Spark, Presto, Glue.Knowledge of DevOps practices, CI/CD pipelines.Experience working closely with Design and Product teams to deliver high-quality user experiences.Excellent problem-solving skills and a strong attention to detail.Strong communication and collaboration abilities.Preferred :Experience with
Large Scale Data/ML System Design .Experience with
Python
and
C++ .Experience with the
Autonomous Driving Industry .
#J-18808-Ljbffr
Houston, TXCompany Introduction
At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up and the wisdom of seasoned experts, Bot Auto boasts a team that has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create miracles and propel the future of transportation. Join us and transform your dreams into reality.We are looking for a skilled and versatile Full Stack Data Engineer to join our team. This unique role is ideal for candidates who bring a strong foundation in both full stack development and data engineering. As a Full Stack Data Engineer, you’ll play a key role in advancing our autonomous driving data workflows, building high-performance internal tools, and developing our hybrid-Cloud data platform. Your work will span from developing web-based interfaces and dashboards to architecting robust data storage, extraction, and transformation pipelines.Key Responsibilities
Full Stack Data Platform:
Design and develop full-stack solutions, including web applications and dashboards, to support data monitoring, visualization, and flow management across autonomous driving data workflows.Collaborate with the infrastructure team to deploy and manage the data platform across hybrid-cloud solutions, utilizing both cloud-native compute services and on-premises data centers.Architect systems with high availability and elasticity by applying principles of stateful and stateless microservices, event queuing, caching strategies, load balancing, and API gateways.Data Engineering:
Build and maintain high-performance data collection pipelines that facilitate seamless data transfer from autonomous systems to both cloud and on-premises environments.Develop robust data ingestion pipelines that pull from CoreDB, external APIs, autonomous driving datasets, and streaming sources, integrating data efficiently into our Data Lake.Architect and optimize large-scale data storage solutions, ensuring efficient, scalable data management within our hybrid-cloud infrastructure.Analytical Solutions:
Create intuitive, user-friendly dashboards and analytics tools that empower executives, algorithm teams, and operations to access actionable insights and data-driven decision-making.Construct and maintain the Data Lakehouse and data visualization dashboards, supporting real-time analytics for strategic decision-making.Cross-functional Collaboration:
Work closely with cross-functional teams to deploy and integrate solutions that enhance the efficiency and effectiveness of data processes across the autonomous driving platform.Support the development of scalable ETL processes and transformation pipelines to provide timely analytics, reporting, and insights across teams.Qualifications
Required :Bachelor's degree in Computer Science, Engineering, or related field.Proven experience in software engineering with a focus on modern web technologies.Strong proficiency in React, Typescript, and CSS. Solid understanding of software architecture, data modeling, and database management.Strong with databases such as MySQL and Postgres, with experience in designing and managing them for data-driven applications.Experience with cloud platforms (AWS, GCP, or Azure) and hybrid-Cloud solutions.Experience with ETL processes, data transformation, and handling large datasets efficiently with distributed data processing engines such as Spark, Presto, Glue.Knowledge of DevOps practices, CI/CD pipelines.Experience working closely with Design and Product teams to deliver high-quality user experiences.Excellent problem-solving skills and a strong attention to detail.Strong communication and collaboration abilities.Preferred :Experience with
Large Scale Data/ML System Design .Experience with
Python
and
C++ .Experience with the
Autonomous Driving Industry .
#J-18808-Ljbffr