Mindteck
AWS ML Ops/Dev Ops Engineer
Mindteck, Plano, Texas, us, 75086
Job Title: AWS DevOps/MLOps Engineer
Job Description:
CLIENT is seeking a talented AWS DevOps/MLOps Lead to develop platforms for big data and data science on AWS. As models, apps, and data pipelines are created and operationalized, the big data and data science team requires engineers with an understanding of cloud-native technology to develop, manage, automate, and facilitate the operational capabilities of the big data and data science team.
Required Skills:
Experience in AWS system and network architecture design, with specific focus on AWS Sagemaker and AWS ECS
Experience developing and maintaining Client systems built with open source tools
Experience developing with containers and Kubernetes in cloud computing environments
Experience with one or more data-oriented workflow orchestration frameworks (KubeFlow, Airflow, Argo)
Design the data pipelines and engineering infrastructure to support our clients' enterprise machine learning systems at scale
Develop and deploy scalable tools and services for our clients to handle machine learning training and inference
Support model development, with an emphasis on auditability, versioning, and data security
Experience with data security and privacy solutions such as Denodo, Protegrity, and synthetic data generation
Ability to develop applications using Python and deploy to AWS Lambda and API Gateway
Ability to develop Jenkins pipelines using the Groovy scripting
Good understanding in testing frameworks like Py/Test
Ability to work with AWS services like S3, DynamoDB, Glue, Redshift, and RDS
Proficient understanding of Git and version control systems
Familiarity with continuous integration and continuous deployment
Develop the Terraform modules to deploy the standard infrastructure
Ability to develop the deployment pipelines using Jenkins and XL Release
Experience in Python boto3 to automate the cloud operations
Experience in documenting technical solutions and solution diagrams
Good understanding of simple Python applications which can be deployed as a Docker container
Experience in creating workflows using AWS Step Functions
Create Docker images using the custom Python libraries
Additional Required Skills:
AWS (experience mandatory):
S3, KMS, IAM, EC2, ECS, BATCH, ECR, Lambda, Data Sync, EFS, IAM Roles, Policies, Cloud Trail, Cost Explorer, ACM, AWS Route53, SNS, SQS, ELB, CloudWatch, Lambda, VPC, Service Catalog Automation (experience mandatory):
Terraform, Python (boto3), serverless, Jenkins (Groovy), NodeJs Big Data (Knowledge):
Redshift, DynamoDB, Databricks, Glue, Athena Data Science (Experience):
Sagemaker, Athena, Glue, DynamoDB, Databricks, MWAA (Airflow) DevOps (experience mandatory):
Python, Terraform, Jenkins, GitHub, Make files, Shell scripting Data Virtualization (Knowledge):
Denodo Data Security (Knowledge):
Protegrity Qualifications: Bachelor's degree from a reputed institution/university 10+ years of building end-to-end systems as a Platform Engineer, Client DevOps Engineer, or Data Engineer 4+ years of experience in Python, Groovy, and Java programming Experience working in the SCRUM environment
#J-18808-Ljbffr
S3, KMS, IAM, EC2, ECS, BATCH, ECR, Lambda, Data Sync, EFS, IAM Roles, Policies, Cloud Trail, Cost Explorer, ACM, AWS Route53, SNS, SQS, ELB, CloudWatch, Lambda, VPC, Service Catalog Automation (experience mandatory):
Terraform, Python (boto3), serverless, Jenkins (Groovy), NodeJs Big Data (Knowledge):
Redshift, DynamoDB, Databricks, Glue, Athena Data Science (Experience):
Sagemaker, Athena, Glue, DynamoDB, Databricks, MWAA (Airflow) DevOps (experience mandatory):
Python, Terraform, Jenkins, GitHub, Make files, Shell scripting Data Virtualization (Knowledge):
Denodo Data Security (Knowledge):
Protegrity Qualifications: Bachelor's degree from a reputed institution/university 10+ years of building end-to-end systems as a Platform Engineer, Client DevOps Engineer, or Data Engineer 4+ years of experience in Python, Groovy, and Java programming Experience working in the SCRUM environment
#J-18808-Ljbffr