Base2 Solutions
Data Integration Engineer
Base2 Solutions, Bethesda, Maryland, us, 20811
Your job will be to design, implement, maintain, and monitor data pipelines, both in support of R&D prototypes and production pipelines. You succeed through effective cross functional collaboration in areas such as, but not limited to, development, product, and QA in a dynamic and fast paced environment.
Job Description
Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.)Ensure data integrity by performing employing data engineering best practices.Maintain database and data pipeline documentation, data dictionaries, and system diagrams.Required Skills
Bachelor's Degree and 12 years of prior relevant experience or Masters with 10 years of prior relevant experience.Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc.Experience with DevOps / MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms.Must possess an active TS/SCI clearance and the ability to obtain and maintain a TS/SCI with Polygraph.Experience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.Expertise in data profiling techniques and understanding the content from both a data quality and business perspective.Experience with data quality and accuracy evaluation techniques.Experience with Agile practices.Development experience with Python.Experience on data model development, modification and migration, and maintenance.Strong verbal and written communication skills.Enthusiastic with the ability to work well on a team and a self-starter who can work independently.Desired Skills
Experience supporting data teams and data scientists.Experience on a production/ enterprise system.Experience in air-gapped environments.Application development and deployment in an AWS environment.AWS certifications.
Job Description
Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.)Ensure data integrity by performing employing data engineering best practices.Maintain database and data pipeline documentation, data dictionaries, and system diagrams.Required Skills
Bachelor's Degree and 12 years of prior relevant experience or Masters with 10 years of prior relevant experience.Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc.Experience with DevOps / MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms.Must possess an active TS/SCI clearance and the ability to obtain and maintain a TS/SCI with Polygraph.Experience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.Expertise in data profiling techniques and understanding the content from both a data quality and business perspective.Experience with data quality and accuracy evaluation techniques.Experience with Agile practices.Development experience with Python.Experience on data model development, modification and migration, and maintenance.Strong verbal and written communication skills.Enthusiastic with the ability to work well on a team and a self-starter who can work independently.Desired Skills
Experience supporting data teams and data scientists.Experience on a production/ enterprise system.Experience in air-gapped environments.Application development and deployment in an AWS environment.AWS certifications.