Expression
Data Ops Engineer
Expression, Annapolis, Maryland, United States, 21403
Overview:
Expression is seeking a skilled Data Ops Engineer to join our team in Annapolis, MD. As a Data Ops Engineer, you will play a pivotal role in managing and optimizing our data infrastructure and pipelines. You will be responsible for ensuring the reliability, efficiency, and scalability of our data systems, enabling seamless data flows and empowering data-driven decision-making across the organization. In this role, you will be the main interface between the Data and Infrastructure teams.
Responsibilities:
Data Infrastructure Management:
Design, implement, and maintain robust data infrastructure, including databases, data warehouses, and data lakes, to support our growing data needs.
Data Pipeline Development:
Develop, deploy, and monitor data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data systems. Ensure data quality and integrity throughout the process.
Automation and Orchestration:
Implement automation and orchestration tools to streamline data operations, reduce manual intervention, and improve efficiency.
Performance Optimization:
Continuously optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness. Identify and resolve bottlenecks and inefficiencies.
Monitoring and Alerting:
Establish monitoring and alerting mechanisms to proactively detect and address issues in data pipelines and infrastructure, ensuring high availability and reliability.
Collaboration:
Collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver solutions that meet business needs.
Documentation and Knowledge Sharing:
Document data infrastructure, pipelines, and processes. Share knowledge and best practices with team members to promote learning and continuous improvement.
Requirements:
Top Secret with capability to obtain a CI Poly
Security+ certification (or willingness to get certified within the first month)
Associates degree or higher in engineering, computer science, or related field and 5+ years of experience as a DevOps/Cloud/Software engineer -OR- 8+ years of experience as a DevOps/Cloud/Software engineer
Proficiency in programming languages such as Python, Java, or Scala.
Strong experience with relational databases (e.g., PostgreSQL, MySQL) and big data technologies (e.g., Hadoop, Spark).
Experienced with Elasticsearch and Cloud Search.
Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Experience with data pipeline orchestration tools (e.g., Airflow, Luigi) and workflow automation tools (e.g., Jenkins, GitLab CI/CD).
Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes) is a plus.
Data pipeline management
Proven experience maintaining production systems for external customers
Experience working with Open Source Technologies such as Red Hat (OpenShift) and Linux/Unix
Engaging with Data engineers in troubleshooting issues
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Benefits:
401k matching
PPO and HDHP medical/dental/vision insurance
Education reimbursement
Complimentary life insurance
Generous PTO and holiday leave
Onsite office gym access
Commuter Benefits Plan
About Expression:
Founded in 1997 and headquartered in Washington DC, Expression provides data fusion, data analytics, software engineering, information technology, and electromagnetic spectrum management solutions to the U.S. Department of Defense, Department of State, and national security community. Expression's “Perpetual Innovation” culture focuses on creating immediate and sustainable value for our clients via agile delivery of tailored solutions built through constant engagement with our clients. Expression was ranked #1 on the Washington Technology 2018's Fast 50 list of fastest growing small business Government contractors and a Top 20 Big Data Solutions Provider by CIO Review.
Equal Opportunity Employer/Veterans/Disabled
#J-18808-Ljbffr
Expression is seeking a skilled Data Ops Engineer to join our team in Annapolis, MD. As a Data Ops Engineer, you will play a pivotal role in managing and optimizing our data infrastructure and pipelines. You will be responsible for ensuring the reliability, efficiency, and scalability of our data systems, enabling seamless data flows and empowering data-driven decision-making across the organization. In this role, you will be the main interface between the Data and Infrastructure teams.
Responsibilities:
Data Infrastructure Management:
Design, implement, and maintain robust data infrastructure, including databases, data warehouses, and data lakes, to support our growing data needs.
Data Pipeline Development:
Develop, deploy, and monitor data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data systems. Ensure data quality and integrity throughout the process.
Automation and Orchestration:
Implement automation and orchestration tools to streamline data operations, reduce manual intervention, and improve efficiency.
Performance Optimization:
Continuously optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness. Identify and resolve bottlenecks and inefficiencies.
Monitoring and Alerting:
Establish monitoring and alerting mechanisms to proactively detect and address issues in data pipelines and infrastructure, ensuring high availability and reliability.
Collaboration:
Collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver solutions that meet business needs.
Documentation and Knowledge Sharing:
Document data infrastructure, pipelines, and processes. Share knowledge and best practices with team members to promote learning and continuous improvement.
Requirements:
Top Secret with capability to obtain a CI Poly
Security+ certification (or willingness to get certified within the first month)
Associates degree or higher in engineering, computer science, or related field and 5+ years of experience as a DevOps/Cloud/Software engineer -OR- 8+ years of experience as a DevOps/Cloud/Software engineer
Proficiency in programming languages such as Python, Java, or Scala.
Strong experience with relational databases (e.g., PostgreSQL, MySQL) and big data technologies (e.g., Hadoop, Spark).
Experienced with Elasticsearch and Cloud Search.
Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Experience with data pipeline orchestration tools (e.g., Airflow, Luigi) and workflow automation tools (e.g., Jenkins, GitLab CI/CD).
Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes) is a plus.
Data pipeline management
Proven experience maintaining production systems for external customers
Experience working with Open Source Technologies such as Red Hat (OpenShift) and Linux/Unix
Engaging with Data engineers in troubleshooting issues
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Benefits:
401k matching
PPO and HDHP medical/dental/vision insurance
Education reimbursement
Complimentary life insurance
Generous PTO and holiday leave
Onsite office gym access
Commuter Benefits Plan
About Expression:
Founded in 1997 and headquartered in Washington DC, Expression provides data fusion, data analytics, software engineering, information technology, and electromagnetic spectrum management solutions to the U.S. Department of Defense, Department of State, and national security community. Expression's “Perpetual Innovation” culture focuses on creating immediate and sustainable value for our clients via agile delivery of tailored solutions built through constant engagement with our clients. Expression was ranked #1 on the Washington Technology 2018's Fast 50 list of fastest growing small business Government contractors and a Top 20 Big Data Solutions Provider by CIO Review.
Equal Opportunity Employer/Veterans/Disabled
#J-18808-Ljbffr