Highbrow LLC
Senior Data Engineer
Highbrow LLC, Bloomfield, Iowa, United States, 52537
Job Title: Senior Data EngineerJob ID: 2022-11506
Job Location: Bloomfield, CT, Denver, CO, Austin TX, NYC, NY, virtual work is possible for the right candidates
Employment Type:
W2
Duration:
Long Term
Work Eligibility:
All Work Authorizations are Permitted – No Visa Transfers
Key Technology:
cloud, OO language, database systems, devops, machine learning
Job Responsibilities:
The Senior Data Engineer is responsible for the delivery of a business need end-to-end starting from understanding the requirements to deploying the software into production. This role requires fluency in some of the critical technologies with proficiency in others and a hunger to learn on the job and add value to the business. Critical attributes include Ownership & Accountability.
In addition to Delivery, the Senior Data Engineer should have an automation-first and continuous improvement mindset, driving the adoption of CI/CD tools and supporting the improvement of toolsets/processes.
Key Characteristics and Duties:
Analyze source data and data flows, working with structured and unstructured data.
Build data pipelines to extract, transform, crunch, and store data in various target systems.
Write reference-able & modular code.
Design and architect solutions independently.
Have a passion to learn and take ownership and accountability.
Deep desire for automation using devops practices and toolsets.
Desire to simplify; be entrepreneurial/business-minded.
Skills and Experience Required:
Mandatory:
2+ years being part of Agile teams – Scrum or Kanban.
2+ years of solution architecting in cloud technology (e.g., AWS, Azure, Google Cloud).
6+ years of working in an object-oriented language: Java or Scala and Python.
3+ years of working experience in Apache Spark, PySpark, Apache Airflow.
3+ years of database systems: Hadoop, Teradata, Redshift, Oracle, MySQL, PostgreSQL, MongoDB, Neo4j, Cassandra.
3+ years of devops toolchain: Jenkins, Maven, Artifactory, Docker, Terraform, Ansible.
3+ years of experience in AWS Glue, SNS, SQS, S3, ECS, LAMBDA.
2+ years of working experience with operationalizing Machine Learning models.
Desired:
Understanding of Machine Learning frameworks (e.g., Scikit-learn, SciPy).
Understanding and 1+ years of working experience with Deep Learning frameworks.
Education:
Minimum degree required for position: Bachelor’s degree.
Acceptable Major(s) or Field(s) of Study: Data Science, Computer Science, or any related field.
Skills/Certifications/Licenses:
Nice to have AWS solution architecture and developer certification.
Nice to have data science and Machine Learning certification from a reputed institution.
#J-18808-Ljbffr
Job Location: Bloomfield, CT, Denver, CO, Austin TX, NYC, NY, virtual work is possible for the right candidates
Employment Type:
W2
Duration:
Long Term
Work Eligibility:
All Work Authorizations are Permitted – No Visa Transfers
Key Technology:
cloud, OO language, database systems, devops, machine learning
Job Responsibilities:
The Senior Data Engineer is responsible for the delivery of a business need end-to-end starting from understanding the requirements to deploying the software into production. This role requires fluency in some of the critical technologies with proficiency in others and a hunger to learn on the job and add value to the business. Critical attributes include Ownership & Accountability.
In addition to Delivery, the Senior Data Engineer should have an automation-first and continuous improvement mindset, driving the adoption of CI/CD tools and supporting the improvement of toolsets/processes.
Key Characteristics and Duties:
Analyze source data and data flows, working with structured and unstructured data.
Build data pipelines to extract, transform, crunch, and store data in various target systems.
Write reference-able & modular code.
Design and architect solutions independently.
Have a passion to learn and take ownership and accountability.
Deep desire for automation using devops practices and toolsets.
Desire to simplify; be entrepreneurial/business-minded.
Skills and Experience Required:
Mandatory:
2+ years being part of Agile teams – Scrum or Kanban.
2+ years of solution architecting in cloud technology (e.g., AWS, Azure, Google Cloud).
6+ years of working in an object-oriented language: Java or Scala and Python.
3+ years of working experience in Apache Spark, PySpark, Apache Airflow.
3+ years of database systems: Hadoop, Teradata, Redshift, Oracle, MySQL, PostgreSQL, MongoDB, Neo4j, Cassandra.
3+ years of devops toolchain: Jenkins, Maven, Artifactory, Docker, Terraform, Ansible.
3+ years of experience in AWS Glue, SNS, SQS, S3, ECS, LAMBDA.
2+ years of working experience with operationalizing Machine Learning models.
Desired:
Understanding of Machine Learning frameworks (e.g., Scikit-learn, SciPy).
Understanding and 1+ years of working experience with Deep Learning frameworks.
Education:
Minimum degree required for position: Bachelor’s degree.
Acceptable Major(s) or Field(s) of Study: Data Science, Computer Science, or any related field.
Skills/Certifications/Licenses:
Nice to have AWS solution architecture and developer certification.
Nice to have data science and Machine Learning certification from a reputed institution.
#J-18808-Ljbffr