Logo
Probity Inc.

Data Engineer - ETL Developer 25-DM0316-1

Probity Inc., Chantilly, Virginia, United States, 22021


PLEASE NOTE: This position requires an ACTIVE Top Secret/SCI Clearance with Polygraph. To be considered for this position, you MUST have an ACTIVE Clearance Level of Top Secret/SCI with Polygraph.DescriptionSeeking an experienced, results-oriented, mission-driven ETL Developer with a specialized focus on Data Engineering to perform data model design, data formatting, and ETL development optimized for efficient storage, access, and computation in support of National Security objectives.Responsibilities include, but are not limited to:Active participant of Agile teams responsible for increasing innovation capacity while driving the velocity of development of data ingestion and data analysis.Responsible for synchronized efforts with other tasks in assembling data technologies to control the flow of data from source to value, with the goal of speeding up the process of deriving value and insight.The ideal candidate will have a passion for unlocking the secrets held by a dataset and solid understanding and experience with developing, automating, and enhancing all parts of the data pipeline to include ingestion, processing, storage, and exposing data for consumption.The Data Engineer also implements data tests for quality and also focuses on improving inefficient tooling and adopting new transformative technologies, while maintaining operational continuity.Required Qualifications:ETL experience, to include formats such as XML, JSON, and YML and normalizing data and high-volume data ingestion.3+ years' experience using and ingesting data into SQL and NoSQL database systems.Familiarity with the NEXIS platform.Experience with Apache NiFi.Experience programming in Apache Spark and PySpark.Bachelor’s Degree in Computer Science, Information Systems, Engineering or 20+ years of experience in lieu of degree.14+ years of overall professional experience (12+ years with Masters Degree, 9+ years experience with PhD).Desired Qualifications:Familiarity with building containerized services (e.g. via Docker).Familiarity with data conditioning.Experience developing and maintaining data processing flows.Experience with Amazon Web Services (AWS).Experience with CI/CD pipeline.Experience with Agile Methodologies and Kanban Framework.Experience with utilizing relational databases including the use of MySQL and/or Oracle for designing database schemas.Experience with Linux, REST services, and HTTP.

#J-18808-Ljbffr