Data Engineer Job at Custom Staffing in Herndon

Senior Software Engineer

Direct Hire, Permanent Role
Herndon, VA (20171)- 100% onsite

AMAZING BENEFITS - including 100% employer paid healthcare benefits for employee, paid overtime, 401k match, etc
Rate: Up to $190k salary (some flexibility)

Key Responsibilities:

• Architect and Develop: Lead the design, development, and maintenance of complex, scalable data pipelines.
• Optimize and Troubleshoot: Ensure performance, reliability, and scalability of data pipelines.
• Collaborate: Work closely with engineers and analysts to understand data requirements and deliver high-quality data solutions.
• ETL Processes: Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar.
• Data Quality: Ensure data quality and consistency through rigorous testing, validation, and governance practices.
• Cloud Infrastructure: Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure).
• DevOps Practices: Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes.
• Mentorship: Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration.
• Innovation: Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team.

Qualifications:

• Educational Background: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Experience: 7+ years of experience in data engineering or related roles.
• Technical Skills: Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Big Data Technologies: Extensive experience with big data technologies (e.g., Hadoop, Spark).
• Cloud Platforms: Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services.
• DevOps Expertise: Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes).
• Problem-Solving: Proven ability to optimize and troubleshoot complex data systems and pipelines.
• Communication: Excellent problem-solving skills and attention to detail.
• Leadership: Strong communication and leadership abilities, with experience mentoring junior engineers.

Preferred Qualifications:

• NoSQL Databases: Experience with NoSQL databases (e.g., MongoDB).
• Programming Languages: Proficiency in programming languages such as Python, Java, or Kotlin.
• Data Visualization: Experience with data visualization tools (e.g., Tableau, Power BI).
• Data Governance: Strong understanding of data governance and security practices.
• Agile/Scrum: Experience working in Agile/Scrum environments.