DoD Data Engineer

Job Description DoD Data Engineer Location: Hybrid - Arlington, VA (1-3 days/Week) Clearance Requirement: Active Secret This is a full-time opportunity with a Department of Defense (DoD) organization in the Washington, DC area. Strong compensation offered for the right candidate. Responsibilities: As a Data Engineer, you will increase DoD leader decision space, drive understanding of strategic risk, and develop recommended courses of action. Analysts employ expert judgment, adaptable methodologies, repeatable analytic processes, and enterprise-wide collaboration to provide routine, special interest, and alert-triggered campaign assessments, and when necessary, facilitate and synchronize enterprise-level campaign adjustment. Analysts will utilize a flexible and foundational toolset to add value across campaigning topics, blending functional area knowledge with an ability to identify data sources, manipulate data, use data analytics tools, understand/anticipate strategic intent, and communicate with senior DoD leaders. We're looking for the right combination of data engineering skills and candidates with experience in these functional areas: Strategy and Operational Concepts; Logistics and Supply Chain; Defense and Military Operations and Activities; Authorities and Permissions; Defense and Military Agreements; Command and Control Arrangements; Strategic Influence. Responsibilities include: • Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks • Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures • Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets • Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing • Leverage big data technologies to efficiently process and analyze very large datasets, similar to those encountered in a federal agency • Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes • Troubleshoot data-related problems and provide innovative solutions to address complex data challenges • Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices Basic Qualifications: • Familiarity with the Pentagon, DoD organization/structure, and senior leader decision-making and experience interfacing with senior DoD leaders • 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch • High level of proficiency in ETL processes and demonstrated hands-on experience with technologies such as DataBricks, Python, Spark, Scala, JavaScript/ JSON, SQL, and Jupyter Notebooks • Strong problem-solving skills and ability to solve complex data-related issues. • TS/SCI clearance