Logistics Management Institute
Data Engineer - Clearance Required
Logistics Management Institute, Mc Lean, Virginia, us, 22107
OverviewLMI is seeking a skilled Data Engineer to design, develop, test, and enhance data pipelines and database architectures. This role will also involve implementing a robust test and evaluation (T&E) strategy to support a comprehensive supply chain risk management program for the Department of Defense.
Responsibilities
Set up segmented databases to control access to various datasets and data products
Build data pipelines in PySpark using data engineering best practices for testing, validation, automation, and version control
Coordinate closely with SMEs and front-end developers to generate data tables required for UI execution
Build code to execute pulls from APIs, allowing access to external data to be pulled into the client environment
Interact with partners and data providers to understand their data holdings, methods for moving data into the CDAO-Advana platform, and data usage agreements
Self-starter, and eager to learn and work in a team environment
Implement a test and evaluation framework for both front end and back end components of an enterprise solution including data products, modeling products and UI
Implement a test harness to systematically assess and validate the functionality and performance of solution components
Collaborate with stakeholders to refine testing protocols, ensuring they align with operational requirements and customer priorities for supply chain risk management
Identify practical test and training data sets for each evaluation
Document test findings and provide actionable insights to improve the system's reliability and effectiveness in real-time operational settings
Spearhead the integration of T&E methodologies into the ongoing development lifecycle to continuously adapt and enhance enterprise solution capabilities
Collaborate closely with data engineers, UI developers, and domain experts to refine and integrate data science methodologies into an adaptive software ecosystem
Operate proficiently within a Databricks environment, managing code development, testing, and deployment through notebooks
Qualifications
Bachelor’s degree in Computer Science or related field and/or equivalent work experience
3-10 years of experience as a data engineer
Experience with:
Agile-based development
Python, Spark, notebooks
Data Bricks or similar environment
Effective analytical, conceptual, and problem-solving skills
Active DoD Secret clearance
Fully remote capability acceptable
Desired Qualifications
Active DoD Top Secret clearance
Part-time onsite client support in the Washington, DC metro area
The salary range for this position is- $80,000 - $120,000
The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances.
Responsibilities
Set up segmented databases to control access to various datasets and data products
Build data pipelines in PySpark using data engineering best practices for testing, validation, automation, and version control
Coordinate closely with SMEs and front-end developers to generate data tables required for UI execution
Build code to execute pulls from APIs, allowing access to external data to be pulled into the client environment
Interact with partners and data providers to understand their data holdings, methods for moving data into the CDAO-Advana platform, and data usage agreements
Self-starter, and eager to learn and work in a team environment
Implement a test and evaluation framework for both front end and back end components of an enterprise solution including data products, modeling products and UI
Implement a test harness to systematically assess and validate the functionality and performance of solution components
Collaborate with stakeholders to refine testing protocols, ensuring they align with operational requirements and customer priorities for supply chain risk management
Identify practical test and training data sets for each evaluation
Document test findings and provide actionable insights to improve the system's reliability and effectiveness in real-time operational settings
Spearhead the integration of T&E methodologies into the ongoing development lifecycle to continuously adapt and enhance enterprise solution capabilities
Collaborate closely with data engineers, UI developers, and domain experts to refine and integrate data science methodologies into an adaptive software ecosystem
Operate proficiently within a Databricks environment, managing code development, testing, and deployment through notebooks
Qualifications
Bachelor’s degree in Computer Science or related field and/or equivalent work experience
3-10 years of experience as a data engineer
Experience with:
Agile-based development
Python, Spark, notebooks
Data Bricks or similar environment
Effective analytical, conceptual, and problem-solving skills
Active DoD Secret clearance
Fully remote capability acceptable
Desired Qualifications
Active DoD Top Secret clearance
Part-time onsite client support in the Washington, DC metro area
The salary range for this position is- $80,000 - $120,000
The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances.