Data Pipeline Engineer

Data Pipeline Engineer

Gen AI Startup

New York City (Hybrid)

$180,000-$200,000 + Equity

About us:

We are working with a dynamic startup specializing in an innovative management platform with a focus on leveraging ML models to optimize operations. They are currently partnered with some of the biggest clients in their space and are looking to grow out the team.

Role Description:

As a Data Pipeline Engineer, you will be responsible for designing, developing, and maintaining the infrastructure that supports our client's machine learning and data-driven projects. You will manage the orchestration of data flows from various sources, such as industry storage platforms and external APIs, while implementing data quality checks and monitoring the health of the pipelines. Additionally, you'll collaborate closely with the machine learning team to enhance the efficiency of the data pipelines, playing a crucial role in optimizing solutions for the construction industry.

Requirements:

• Design, develop, and maintain data pipeline infrastructure
• Manage and orchestrate the flow of data through various stages of processing to ensure efficiency and effectiveness.
• Ensure visibility and monitor the health of the pipelines
• Integrate data from industry storage platforms, project management tools, and external APIs
• Implement data quality checks and error-handling processes
• Work with the machine learning team to improve pipeline efficiency
• Develop and optimize data models to support efficient data storage, retrieval, and analysis, ensuring alignment with business objectives

The Benefits:

As a Data Pipeline Engineer, you will receive $180,000- $200,000 + equity. This role also includes, 401k, health, dental, and vision care.

How to Apply:

Please register your interest by sending your resume to Neha Nidamarti via the Apply link on this page.

Keywords:

Platform, Engineer, Python, SQL, Pipeline, ML, Machine Learning, API, Data Modeling, NoSQL