The Custom Group of Companies
Data Engineer
The Custom Group of Companies, Herndon, Virginia, United States, 22070
Herndon, VAAMAZING BENEFITS (including 100% employer paid healthcare benefits for employee)Salary Depends On ExperienceMust hold an active Top Secret Security ClearanceFull time - Direct hire!About Us:
We are at the forefront of innovation, leveraging data to drive impactful decisions and solutions. Our team is passionate about harnessing the power of data to transform industries and improve lives. We are looking for a Data Engineer to join our dynamic team and lead the charge in building robust, scalable data pipelines.Key Responsibilities:
Architect and Develop: Lead the design, development, and maintenance of complex, scalable data pipelines.Optimize and Troubleshoot: Ensure performance, reliability, and scalability of data pipelines.Collaborate: Work closely with engineers and analysts to understand data requirements and deliver high-quality data solutions.ETL Processes: Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar.Data Quality: Ensure data quality and consistency through rigorous testing, validation, and governance practices.Cloud Infrastructure: Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure).DevOps Practices: Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes.Mentorship: Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration.Innovation: Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team.Qualifications:
Educational Background: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.Experience: 7+ years of experience in data engineering or related roles.Technical Skills: Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).Big Data Technologies: Extensive experience with big data technologies (e.g., Hadoop, Spark).Cloud Platforms: Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services.DevOps Expertise: Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes).Problem-Solving: Proven ability to optimize and troubleshoot complex data systems and pipelines.Communication: Excellent problem-solving skills and attention to detail.Leadership: Strong communication and leadership abilities, with experience mentoring junior engineers.Preferred Qualifications:
NoSQL Databases: Experience with NoSQL databases (e.g., MongoDB).Programming Languages: Proficiency in programming languages such as Python, Java, or Kotlin.Data Visualization: Experience with data visualization tools (e.g., Tableau, Power BI).Data Governance: Strong understanding of data governance and security practices.Agile/Scrum: Experience working in Agile/Scrum environments.Why Join Us?
Innovative Environment: Be part of a team that values creativity and innovation.Growth Opportunities: Continuous learning and professional development opportunities.Collaborative Culture: Work in a supportive and collaborative environment.Impactful Work: Contribute to projects that make a real difference.Join us and be part of an exciting journey to harness the power of data and technology for a greater cause!
#J-18808-Ljbffr
We are at the forefront of innovation, leveraging data to drive impactful decisions and solutions. Our team is passionate about harnessing the power of data to transform industries and improve lives. We are looking for a Data Engineer to join our dynamic team and lead the charge in building robust, scalable data pipelines.Key Responsibilities:
Architect and Develop: Lead the design, development, and maintenance of complex, scalable data pipelines.Optimize and Troubleshoot: Ensure performance, reliability, and scalability of data pipelines.Collaborate: Work closely with engineers and analysts to understand data requirements and deliver high-quality data solutions.ETL Processes: Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar.Data Quality: Ensure data quality and consistency through rigorous testing, validation, and governance practices.Cloud Infrastructure: Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure).DevOps Practices: Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes.Mentorship: Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration.Innovation: Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team.Qualifications:
Educational Background: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.Experience: 7+ years of experience in data engineering or related roles.Technical Skills: Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).Big Data Technologies: Extensive experience with big data technologies (e.g., Hadoop, Spark).Cloud Platforms: Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services.DevOps Expertise: Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes).Problem-Solving: Proven ability to optimize and troubleshoot complex data systems and pipelines.Communication: Excellent problem-solving skills and attention to detail.Leadership: Strong communication and leadership abilities, with experience mentoring junior engineers.Preferred Qualifications:
NoSQL Databases: Experience with NoSQL databases (e.g., MongoDB).Programming Languages: Proficiency in programming languages such as Python, Java, or Kotlin.Data Visualization: Experience with data visualization tools (e.g., Tableau, Power BI).Data Governance: Strong understanding of data governance and security practices.Agile/Scrum: Experience working in Agile/Scrum environments.Why Join Us?
Innovative Environment: Be part of a team that values creativity and innovation.Growth Opportunities: Continuous learning and professional development opportunities.Collaborative Culture: Work in a supportive and collaborative environment.Impactful Work: Contribute to projects that make a real difference.Join us and be part of an exciting journey to harness the power of data and technology for a greater cause!
#J-18808-Ljbffr