Logo
Highbrow LLC

Senior Data Engineer

Highbrow LLC, Denver, Colorado, United States, 80285


Job Title: Senior Data EngineerJob ID: 2022-11506

Job Location: Bloomfield, CT, Denver, CO, Austin TX, NYC, NY, virtual work is possible for the right candidates

Employment Type:

W2

Duration:

Long Term

Work Eligibility:

All Work Authorizations are Permitted – No Visa Transfers

Key Technology:

cloud, OO language, database systems, devops, machine learning

Job Responsibilities:

The Senior Data Engineer is responsible for the delivery of a business need end-to-end starting from understanding the requirements to deploying the software into production. This role requires fluency in some of the critical technologies with proficiency in others and a hunger to learn on the job and add value to the business. Critical attributes include Ownership & Accountability.

In addition to Delivery, the Senior Data Engineer should have an automation-first and continuous improvement mindset, driving the adoption of CI/CD tools and supporting the improvement of toolsets/processes.

Key Characteristics and Duties:

Analyze source data and data flows, working with structured and unstructured data.

Build data pipelines to extract, transform, crunch, and store data in various target systems.

Write reference-able & modular code.

Design and architect solutions independently.

Have a passion to learn and take ownership and accountability.

Deep desire for automation using devops practices and toolsets.

Desire to simplify; be entrepreneurial/business-minded.

Skills and Experience Required:

Mandatory:

2+ years being part of Agile teams – Scrum or Kanban.

2+ years of solution architecting in cloud technology (e.g., AWS, Azure, Google Cloud).

6+ years of working in an object-oriented language: Java or Scala and Python.

3+ years of working experience in Apache Spark, PySpark, Apache Airflow.

3+ years of database systems: Hadoop, Teradata, Redshift, Oracle, MySQL, PostgreSQL, MongoDB, Neo4j, Cassandra.

3+ years of devops toolchain: Jenkins, Maven, Artifactory, Docker, Terraform, Ansible.

3+ years of experience in AWS Glue, SNS, SQS, S3, ECS, LAMBDA.

2+ years of working experience with operationalizing Machine Learning models.

Desired:

Understanding of Machine Learning frameworks (e.g., Scikit-learn, SciPy).

Understanding and 1+ years of working experience with Deep Learning frameworks.

Education:

Minimum degree required for position: Bachelor’s degree.

Acceptable Major(s) or Field(s) of Study: Data Science, Computer Science, or any related field.

Skills/Certifications/Licenses:

Nice to have AWS solution architecture and developer certification.

Nice to have data science and Machine Learning certification from a reputed institution.

#J-18808-Ljbffr