Secret RDIM Software Data Engineer

As an RDIM Software (Data) Engineer, you will contribute to the development and optimization of the Readiness Decision Impact Model (RDIM) and its supporting tools. This position combines advanced data engineering techniques, software development, and analytics to support senior leaders in making strategic decisions that impact national security. You will work with technologies such as Databricks, Spark, and AWS GovCloud while utilizing programming languages like Python, SQL, R, and Scala to design efficient data pipelines and analysis tools. Key Responsibilities Model and Data Development: Enhance and manage the Python-based RDIM, integrating advanced models across the Department of Defense (DoD) using the Advana platform. Design and implement efficient Extract, Load, and Transform (ELT) processes for DoD data using PySpark, SQL, and Python. Maintain detailed documentation on data sources, architecture, and workflows to ensure data pedigree compliance. Visualization and Reporting: Support the development of the Readiness Analytics Visualization Environment (RAVEN), a tool for senior leaders to access RDIM insights. Perform advanced data mining and create detailed ad-hoc analyses to inform decisions. Software Lifecycle Management: Ensure compliance with ISO/IEEE 29148-2018 standards, driving lifecycle processes such as test readiness reviews (TRRs) and software deployment. Support GitLab CI/CD maintenance and development in AWS GovCloud. Collaboration: Partner with DoD Data Science, Data Engineering, and Web Development teams to streamline development processes. Work both independently and as part of a team to deliver high-quality, timely solutions. Qualifications Required: Bachelor’s degree in Information Technology, Computer Science, Software Engineering, or a related field. 3 years of experience in data engineering and software development, or equivalent. Proficiency with programming languages such as Python, SQL, R, or Scala. Experience with ETL/ELT processes and tools, cloud platforms, and database architecture. Knowledge of Agile/Scrum methodologies and Git source control. Preferred: Familiarity with Spark, PySpark, Databricks, Hive, and AWS GovCloud. Understanding of DoD analytics and operational processes. Active Secret clearance (Top Secret clearance preferred). Skills: Strong analytical and problem-solving skills with acute attention to detail. Ability to work collaboratively in a dynamic environment. Effective communication skills to translate technical solutions for non-technical stakeholders.