Cloud Data Engineer

Responsibilities:Integrate existing AWS resources into managed applications, deployed through an Infrastructure-as-Code (IaC) and CI/CD pipeline.Build new data pipelines, emphasizing the use of serverless AWS services, for both batch and streaming data flows. Utilize IaC and CI/CD to manage versioning, testing, and deployment.Incorporate monitoring into data pipelines and set up alerting for component failure.Advise on and implement security leading practices and strategies according to the AWS Well-Architected Framework.Build ETL scripts in AWS Glue and maintain the data store, including monitoring for schema migration and generating documentation such as an ERD. Incorporate leading practices for version control and change management.Success Factors / Job Competencies:Motivation and ability to research, advise on, and construct the best architecture to solve technical problems.Ability and commitment to produce high-quality programmatic code, including documentation.Highly self-motivated and directed, with a willingness to expand duties when needs present.Strong verbal communication skills and a commitment to collaboratively discuss and solve technical problems.Required Job Qualifications:At least 5 years of experience building resources in AWS.Proficiency in Infrastructure-as-Code tools such as AWS CDK or Pulumi.Proficiency in DevOps leading practices and building CI/CD pipelines.AWS Certifications as a Cloud Practitioner and Associate Solutions Architect.Desired Job Qualifications:Advanced AWS Certifications, such as Data Analytics, Security, and DevOps Engineer.Specific experience building data pipelines in AWS with serverless resources.Python proficiency.Experience with MLOps pipelines.

#J-18808-Ljbffr