BigBear Inc
Data Integration Engineer
BigBear Inc, Bethesda, Maryland, us, 20811
Overview
BigBear.ai
is hiring a cleared
Data Integration Engineer
(active TS/SCI is required)to support he National Media Exploitation Center (NMEC) contract. In this role you can expect to be part of a mission focused, solutions oriented, and adaptive team that values innovation, collaboration, and professional development. You will design, implement, maintain, and monitor data pipelines, both in support of R&D prototypes and production pipelines. Most of this work will be conducted on-site at the client location in Bethesda, MD, however we do offer a flexible schedule and some unclassified development tasks may be performed remotely. The percentage of partial remote work will vary based on client requirements/deliverables.What you will do
This position works closely with other infrastructure and network engineers, data scientists, and system engineers on the following key tasks:Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qanat, Milvus, etc.)Ensure data integrity by performing employing data engineering best practicesMaintain database and data pipeline documentation, data dictionaries, and system diagramsWhat you need to have
Bachelor's Degree and 12+ years of prior relevant experience or master's with 10+ years of prior relevant experienceExperience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qanat, etc.Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dragster, Prefect, Argocd, Meta flow, Kubeflow, etc.Experience with DevOps / Mops, using CI/CD methodology with data pipelines, and cloud-native deployment paradigmsMust possess an active TS/SCI clearance and the ability to obtain and maintain a TS/SCI with PolygraphExperience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.Expertise in data profiling techniques and understanding the content from both a data quality and business perspectiveExperience with data quality and accuracy evaluation techniquesExperience with Agile practicesDevelopment experience with PythonExperience on data model development, modification and migration, and maintenanceStrong verbal and written communication skillsEnthusiastic with the ability to work well on a team and a self-starter who can work independently.What we'd like you to have
Hold an Active TS/SCI with C/I PolyExperience supporting data teams and data scientistsExperience on a production/ enterprise systemExperience in air-gapped environmentsApplication development and deployment in an AWS environmentAWS certifications
About BigBear.ai
BigBear.ai delivers AI-powered analytics and cyber engineering solutions to support mission-critical operations and decision-making in complex, real-world environments. BigBear.ai's customers, which include the US Intelligence Community, Department of Defense, the US Federal Government, as well as customers in manufacturing, healthcare, commercial space, and other sectors, rely on BigBear.ai's solutions to see and shape their world through reliable, predictive insights and goal-oriented advice. Headquartered in Columbia, Maryland, BigBear.ai is a global, public company traded on the NYSE under the symbol BBAI. For more information, please visit: http://bigbear.ai/ and follow BigBear.ai on Twitter: @BigBearai.
BigBear.ai
is hiring a cleared
Data Integration Engineer
(active TS/SCI is required)to support he National Media Exploitation Center (NMEC) contract. In this role you can expect to be part of a mission focused, solutions oriented, and adaptive team that values innovation, collaboration, and professional development. You will design, implement, maintain, and monitor data pipelines, both in support of R&D prototypes and production pipelines. Most of this work will be conducted on-site at the client location in Bethesda, MD, however we do offer a flexible schedule and some unclassified development tasks may be performed remotely. The percentage of partial remote work will vary based on client requirements/deliverables.What you will do
This position works closely with other infrastructure and network engineers, data scientists, and system engineers on the following key tasks:Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qanat, Milvus, etc.)Ensure data integrity by performing employing data engineering best practicesMaintain database and data pipeline documentation, data dictionaries, and system diagramsWhat you need to have
Bachelor's Degree and 12+ years of prior relevant experience or master's with 10+ years of prior relevant experienceExperience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qanat, etc.Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dragster, Prefect, Argocd, Meta flow, Kubeflow, etc.Experience with DevOps / Mops, using CI/CD methodology with data pipelines, and cloud-native deployment paradigmsMust possess an active TS/SCI clearance and the ability to obtain and maintain a TS/SCI with PolygraphExperience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.Expertise in data profiling techniques and understanding the content from both a data quality and business perspectiveExperience with data quality and accuracy evaluation techniquesExperience with Agile practicesDevelopment experience with PythonExperience on data model development, modification and migration, and maintenanceStrong verbal and written communication skillsEnthusiastic with the ability to work well on a team and a self-starter who can work independently.What we'd like you to have
Hold an Active TS/SCI with C/I PolyExperience supporting data teams and data scientistsExperience on a production/ enterprise systemExperience in air-gapped environmentsApplication development and deployment in an AWS environmentAWS certifications
About BigBear.ai
BigBear.ai delivers AI-powered analytics and cyber engineering solutions to support mission-critical operations and decision-making in complex, real-world environments. BigBear.ai's customers, which include the US Intelligence Community, Department of Defense, the US Federal Government, as well as customers in manufacturing, healthcare, commercial space, and other sectors, rely on BigBear.ai's solutions to see and shape their world through reliable, predictive insights and goal-oriented advice. Headquartered in Columbia, Maryland, BigBear.ai is a global, public company traded on the NYSE under the symbol BBAI. For more information, please visit: http://bigbear.ai/ and follow BigBear.ai on Twitter: @BigBearai.