Motion Recruitment
Motion Recruitment is hiring: Data Engineer / Databricks / 100% remote in New Yo
Motion Recruitment, New York, NY, United States
We are currently seeking a Senior Data Engineer with expertise in Databricks at a cutting-edge start-up.
The company is focused on leveraging big data and analytics to provide actionable insights to its clients. As a Senior Data Engineer, you will be instrumental in designing, building, and maintaining scalable data pipelines using Databricks and other cloud-based platforms.
The ideal candidate has extensive experience in data engineering, working with large-scale data infrastructures, and optimizing ETL processes.
Required Skills & Experience:
Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
At least 5 years of experience in data engineering, with a focus on building data pipelines.
Proven experience with Databricks and Apache Spark.
Strong proficiency in Python or Scala.
Experience with cloud platforms such as AWS or Azure.
Expertise in building and optimizing ETL processes.
Desired Skills & Experience: Experience with real-time data processing.
Knowledge of ML model deployment within data pipelines.
Familiarity with Delta Lake and data lakes architecture.
What You Will Be Doing:
Tech Breakdown: 60% Databricks & Spark Development
40% ETL Optimization
Daily Responsibilities: 70% Hands-On Coding
20% Data Pipeline Design & Development
10% Documentation & Reporting
Posted by: Julie Bennett
Specialization: Python Machine Learning/Data Science