Data Engineer - Scala
Jobot, New York, NY, United States
This Jobot Consulting Job is hosted by: Duran Workman
Are you a fit? Easy Apply now by clicking the "Apply Now" button
and sending us your resume.
Salary: $75 - $95 per hour
A bit about us:We are seeking a dynamic and experienced Consulting Data Engineer - Scala in the technology industry. This role will be a key player in our team, responsible for designing and implementing data processing systems and service solutions. The ideal candidate will have a strong background in SQL, ETL, Apache Spark, and Medallion Architecture, with a minimum of 5 years of experience in a similar role.
Why join us?- 100% Remote
- Recognized Top Employer
- Great Benefits for Contractor, plus 401k
- Opportunity to convert to FTE
Responsibilities:
- Design, develop, and implement ETL processes, database designs, and data models using SQL, Apache Spark, and Medallion Architecture.
- Work closely with data scientists and analysts to understand and implement data requirements.
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
- Collaborate with stakeholders and project teams to understand business needs and devise possible solutions.
- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
- Develop processes and tools to monitor and analyze data accuracy and performance.
- Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
- Minimum of 5 years of experience in a Data Engineer role.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
- Strong analytic skills related to working with unstructured datasets.
- Proficient in Scala, SQL, ETL, Apache Spark, and Medallion Architecture.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Strong project management and organizational skills.
- Excellent written and verbal communication skills.
- Ability to work in a fast-paced and agile development environment.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Strong understanding of the latest industry trends and technologies.
Join our team and use your maximum potential. Discover new opportunities to grow your career as a Covance FSP Data Engineer. Our flexible and creative solutions improve efficiency and reduce costs for our clients. So, if you are ready to make a meaningful impact in a professionally challenging yet exciting environment, apply now!
Interested in hearing more? Easy Apply now by clicking the "Apply Now" button.