Synechron
AWS Devops Infrastructure Engineer with EMR cluster
Synechron, Piscataway, New Jersey, us, 08854
Job Summary:
We are seeking an
AWS EMR Engineer
who is passionate about data processing and
infrastructure automation . The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with
AWS DevOps
tools such as
Code Deploy and Jenkins.
This role will focus on automating infrastructure deployments, writing validation checks, and enhancing our data processing capabilities using
AWS EMR.Key Responsibilities:Design, implement, and manage
AWS EMR clusters
for large-scale data processing tasks.Develop and maintain CI/CD pipelines using tools like Jenkins and Code Deploy to automate deployment processes.Write and manage infrastructure as code
(IaC) using Terraform,
including reading and interpreting Terraform plans for effective infrastructure deployment.Create, execute, and optimize data pipelines to run Bash or Python scripts for automating deployments and validation checks.Collaborate with cross-functional teams to gather requirements and implement efficient workflows for data processing and infrastructure management.Ensure high availability and performance of E MR jobs and troubleshoot
any issues that arise.Document processes, workflows, and architectural designs for future reference and knowledge sharing.Implement best practices for security, governance, and compliance within the AWS environment.Qualifications:Bachelor's degree in Computer Science, Information Technology, or a related field.Proven experience with AWS EMR, including configuration and management of EMR clusters.Strong understanding of API development and integration.Hands-on experience with AWS DevOps tools, including Code Deploy, Jenkins, or equivalent.Familiarity with Terraform for infrastructure provisioning and management, including the ability to read and interpret plans.Proficient in scripting languages such as Bash or Python for automation tasks.Excellent problem-solving skills, attention to detail, and a proactive approach to challenges.Preferred Qualifications:AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified DevOps Engineer).Experience with monitoring and logging tools (e.g., CloudWatch, ELK Stack).Familiarity with data processing frameworks (e.g., Apache Spark).
We are seeking an
AWS EMR Engineer
who is passionate about data processing and
infrastructure automation . The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with
AWS DevOps
tools such as
Code Deploy and Jenkins.
This role will focus on automating infrastructure deployments, writing validation checks, and enhancing our data processing capabilities using
AWS EMR.Key Responsibilities:Design, implement, and manage
AWS EMR clusters
for large-scale data processing tasks.Develop and maintain CI/CD pipelines using tools like Jenkins and Code Deploy to automate deployment processes.Write and manage infrastructure as code
(IaC) using Terraform,
including reading and interpreting Terraform plans for effective infrastructure deployment.Create, execute, and optimize data pipelines to run Bash or Python scripts for automating deployments and validation checks.Collaborate with cross-functional teams to gather requirements and implement efficient workflows for data processing and infrastructure management.Ensure high availability and performance of E MR jobs and troubleshoot
any issues that arise.Document processes, workflows, and architectural designs for future reference and knowledge sharing.Implement best practices for security, governance, and compliance within the AWS environment.Qualifications:Bachelor's degree in Computer Science, Information Technology, or a related field.Proven experience with AWS EMR, including configuration and management of EMR clusters.Strong understanding of API development and integration.Hands-on experience with AWS DevOps tools, including Code Deploy, Jenkins, or equivalent.Familiarity with Terraform for infrastructure provisioning and management, including the ability to read and interpret plans.Proficient in scripting languages such as Bash or Python for automation tasks.Excellent problem-solving skills, attention to detail, and a proactive approach to challenges.Preferred Qualifications:AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified DevOps Engineer).Experience with monitoring and logging tools (e.g., CloudWatch, ELK Stack).Familiarity with data processing frameworks (e.g., Apache Spark).