Custom Staffing
Data Engineer
Custom Staffing, Herndon, Virginia, United States, 22070
Job DescriptionJob Description
Senior Software Engineer
**Direct Hire, Permanent Role
Herndon, VA (20171)- **100% onsite
AMAZING BENEFITS
- including 100% employer paid healthcare benefits for employee, paid overtime, 401k match, etc
Rate:
Up to **** $190k salary (some flexibility)
Key Responsibilities:
Architect and Develop:
Lead the design, development, and maintenance of complex, scalable data pipelines.
Optimize and Troubleshoot:
Ensure performance, reliability, and scalability of data pipelines.
Collaborate:
Work closely with engineers and analysts to understand data requirements and deliver high-quality data solutions.
ETL Processes:
Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar.
Data Quality:
Ensure data quality and consistency through rigorous testing, validation, and governance practices.
Cloud Infrastructure:
Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure).
DevOps Practices:
Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes.
Mentorship:
Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration.
Innovation:
Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team.
Qualifications:
Educational Background:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Experience:
7+ years of experience in data engineering or related roles.
Technical Skills:
Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
Big Data Technologies:
Extensive experience with big data technologies (e.g., Hadoop, Spark).
Cloud Platforms:
Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services.
DevOps Expertise:
Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes).
Problem-Solving:
Proven ability to optimize and troubleshoot complex data systems and pipelines.
Communication:
Excellent problem-solving skills and attention to detail.
Leadership:
Strong communication and leadership abilities, with experience mentoring junior engineers.
Preferred Qualifications:
NoSQL Databases:
Experience with NoSQL databases (e.g., MongoDB).
Programming Languages:
Proficiency in programming languages such as Python, Java, or Kotlin.
Data Visualization:
Experience with data visualization tools (e.g., Tableau, Power BI).
Data Governance:
Strong understanding of data governance and security practices.
Agile/Scrum:
Experience working in Agile/Scrum environments.
Senior Software Engineer
**Direct Hire, Permanent Role
Herndon, VA (20171)- **100% onsite
AMAZING BENEFITS
- including 100% employer paid healthcare benefits for employee, paid overtime, 401k match, etc
Rate:
Up to **** $190k salary (some flexibility)
Key Responsibilities:
Architect and Develop:
Lead the design, development, and maintenance of complex, scalable data pipelines.
Optimize and Troubleshoot:
Ensure performance, reliability, and scalability of data pipelines.
Collaborate:
Work closely with engineers and analysts to understand data requirements and deliver high-quality data solutions.
ETL Processes:
Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar.
Data Quality:
Ensure data quality and consistency through rigorous testing, validation, and governance practices.
Cloud Infrastructure:
Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure).
DevOps Practices:
Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes.
Mentorship:
Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration.
Innovation:
Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team.
Qualifications:
Educational Background:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Experience:
7+ years of experience in data engineering or related roles.
Technical Skills:
Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
Big Data Technologies:
Extensive experience with big data technologies (e.g., Hadoop, Spark).
Cloud Platforms:
Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services.
DevOps Expertise:
Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes).
Problem-Solving:
Proven ability to optimize and troubleshoot complex data systems and pipelines.
Communication:
Excellent problem-solving skills and attention to detail.
Leadership:
Strong communication and leadership abilities, with experience mentoring junior engineers.
Preferred Qualifications:
NoSQL Databases:
Experience with NoSQL databases (e.g., MongoDB).
Programming Languages:
Proficiency in programming languages such as Python, Java, or Kotlin.
Data Visualization:
Experience with data visualization tools (e.g., Tableau, Power BI).
Data Governance:
Strong understanding of data governance and security practices.
Agile/Scrum:
Experience working in Agile/Scrum environments.