Logo
AnaVation LLC

ETL Engineer III - HYBRID Possible!

AnaVation LLC, Huntsville, Alabama, United States, 35824


Description of Task to be Performed:Join our dynamic team where you'll play a vital role in providing direct technical support to advance our customer's mission. As a valued member, you'll collaborate with a talented team, contributing your expertise to drive impactful solutions forward.The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into a Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution.This position is on-site in Huntsville, AL and may have the potential to offer hybrid support, subject to customer approval. This position requires an active Top Secret clearance and the ability to obtain SCI accesses with a polygraph.Required Qualifications:

6 or more years of extraction, transformation, and loading (ETL) experienceIn-depth knowledge of ETL best practices, data integration techniques, and data quality management.Strong proficiency in one or more of the following programming languages: Scala, Java, Python, SQL.Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.Experience working with AWS (such as S3, EC2, Lambda, SNS, RedShift, etc.)Experience with software development and scripting for data ingest.Experience with web services and/or microservices.Experience with Linux (CentOS/RedHat) and Windows environments.Excellent communication skills.Bachelor's degree in Engineering, Computer Science, or other related analytical, scientific, or technical discipline.Preferred Qualifications:

Understanding of concepts of Data Lakehouse architecture as well as OpenSearch.Experience using software repository tools such as GIT or SVN.Experience working within agile methodology