Technica
ETL Engineer- Level III
Technica, Huntsville, Alabama, United States, 35824
Overview:
About Technica:At Technica Corporation, our goal is to provide exceptional professional services and innovative technology solutions that meet or exceed our customers expectations. We specialize in a wide range of advanced information technology solutions from Systems Engineering to Cyber Security, and from Software Development to Product Solutions. From our locations across the DC Metro area, Hampton, Virginia, and Huntsville, Alabama, we provide technological subject matter expertise, program management and business process knowledge as a trusted advisor in support of our Department of Defense and other Federal Agency customers.Responsibilities:Technica Corporation is currently looking for an experienced
ETL Engineer
to join a strong team supporting our government customer. This position will provide the ability to make a significant impact to the mission.
Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs. The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution.Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system.Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process.Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner.This is position is required to be onsite in our Redstone Arsenal location in Huntsville, AL.The government has established policies for on-site vs remote work which varies across divisions and contracts. Staff are obligated to adhere to these and other FBI policies and react accordingly as policies change over time. Where allowed, remote work must be coordinated with the team lead and/or government POC, ensuring there is zero interruption with the delivery of our services.Requirements:Active Top Secret clearance with SCI eligibilityBachelors degree in Engineering, Computer Science, or other related analytical, scientific, or technical disciplineAt least 5 years experience with ETLStrong proficiency in programming languages such as Scala, or Java.Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.In-depth knowledge of ETL best practices, data integration techniques, and data quality management.Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift.Proven experience in the engineering planning and transition of existing system software / data into a Cloud-based AWS solution. Must have experience in Linux command lines and continuous integration.Desired:
At least 6 years experience with ETLUnderstanding of concepts of Data Lakehouse architecture as well as OpenSearch is a plus.Experience using software repository tools such GIT or SVN.
EEO:EQUAL EMPLOYMENT OPPORTUNITYIt is Technica's policy to affirmatively support Equal Employment Opportunity (EEO) for all qualified individuals without regard to color, gender, religion, creed, national origin, age, race, disability, gender identity, genetic information, sexual orientation, marital status, veteran status or any other characteristic protected by law. This policy covers all aspects of the employment relationship including recruiting, hiring, compensation, assignment, promotion, transfer, training, working conditions, employment longevity, retirement, employee benefits and termination.Technica's EEO philosophy promotes equal employment opportunity throughout the organization. Any form of unlawful employee harassment based on the above mentioned characteristics is prohibited. Equal Opportunity Employer Minorities/Women/Vets/Disabled/Gender Identity/Sexual Orientation.
About Technica:At Technica Corporation, our goal is to provide exceptional professional services and innovative technology solutions that meet or exceed our customers expectations. We specialize in a wide range of advanced information technology solutions from Systems Engineering to Cyber Security, and from Software Development to Product Solutions. From our locations across the DC Metro area, Hampton, Virginia, and Huntsville, Alabama, we provide technological subject matter expertise, program management and business process knowledge as a trusted advisor in support of our Department of Defense and other Federal Agency customers.Responsibilities:Technica Corporation is currently looking for an experienced
ETL Engineer
to join a strong team supporting our government customer. This position will provide the ability to make a significant impact to the mission.
Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs. The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution.Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system.Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process.Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner.This is position is required to be onsite in our Redstone Arsenal location in Huntsville, AL.The government has established policies for on-site vs remote work which varies across divisions and contracts. Staff are obligated to adhere to these and other FBI policies and react accordingly as policies change over time. Where allowed, remote work must be coordinated with the team lead and/or government POC, ensuring there is zero interruption with the delivery of our services.Requirements:Active Top Secret clearance with SCI eligibilityBachelors degree in Engineering, Computer Science, or other related analytical, scientific, or technical disciplineAt least 5 years experience with ETLStrong proficiency in programming languages such as Scala, or Java.Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.In-depth knowledge of ETL best practices, data integration techniques, and data quality management.Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift.Proven experience in the engineering planning and transition of existing system software / data into a Cloud-based AWS solution. Must have experience in Linux command lines and continuous integration.Desired:
At least 6 years experience with ETLUnderstanding of concepts of Data Lakehouse architecture as well as OpenSearch is a plus.Experience using software repository tools such GIT or SVN.
EEO:EQUAL EMPLOYMENT OPPORTUNITYIt is Technica's policy to affirmatively support Equal Employment Opportunity (EEO) for all qualified individuals without regard to color, gender, religion, creed, national origin, age, race, disability, gender identity, genetic information, sexual orientation, marital status, veteran status or any other characteristic protected by law. This policy covers all aspects of the employment relationship including recruiting, hiring, compensation, assignment, promotion, transfer, training, working conditions, employment longevity, retirement, employee benefits and termination.Technica's EEO philosophy promotes equal employment opportunity throughout the organization. Any form of unlawful employee harassment based on the above mentioned characteristics is prohibited. Equal Opportunity Employer Minorities/Women/Vets/Disabled/Gender Identity/Sexual Orientation.