Lead AWS Data Engineer

About the job

Lead AWS Data Engineer (Hybrid)

McKinney, TX.

Direct Client

2 rounds of interview. We don't consider Azure or any other cloud service profiles until its used 7-8 years back. Current experience in same title or job role is mandatory.

kaykay@ebusinesstechcorp.com

Role Overview:

In this role, you will be responsible for supporting our Cloud Applications, and driving cloud best practices for application development. This role will support a wide range of applications and solutions supporting multiple teams in the organization. In this role, an employee will work with data engineering, data analysts, business stakeholders and data scientist team(s) to help the organization build out secure, scalable, fault-tolerant, and high performing cloud-based application services.

What You Will Do:

• Design, implement, and support various applications and services on our Cloud Platform.
• It requires a lot of experience specifically in AWS architecture, and a variety of services.
• CDK experience and Python/SQL are definitely needed.
• This person would also be driving out our CI/CD implementations, and experience there is absolutely a plus.
• Provide technological guidance on Data Lake and Enterprise Data Warehouse design, development, implementation, and monitoring.
• Understand, Design and Implement Data Security around cloud infrastructures.
• Provide support and guidance to Data Services and other application development teams on various AWS Database Products.
• Work with leadership on process improvement and strategic initiatives on Cloud Platform.

What You Can Bring:

• Bachelor's degree in Computer Science/Engineering, Information Systems or equivalent work experience in a technical position.
• 5+ years of experience in software development and cloud technologies.
• 3+ years of experience in Software Engineering primarily using Python, and AWS architectures.
• 5+ Years in window functions in SQL, SQL query optimization, and advanced SQL skills.
• Proven experience in building cloud applications and deploying with understanding of CI/CD processes.
• Strong coding and scripting experience with Python, C#, SQL, or similar languages.
• Experience of implementing Airflow in AWS (MWAA) will be a plus.
• AWS Certifications are considered a strong plus.
• Excellent verbal and written communication skills.
• Ability to work independently and as part of a team.
• Strong programming knowledge and experience with Python. Additional languages are a plus.
• Specific working experience with primary AWS Services including Lambda, Glue, EventBridge, SQS, AWSCLI, S3, Redshift.
• Experience with a variety of services such as Athena, EC2, EBS, CloudWatch, CloudTrail, ECS, ECR, EMR, IAM, SNS, SES etc.
• Extensive hands-on experience including design and implementation across a broad range of database services on Amazon Web Services (AWS).
• Solid understanding of various Data Management and Data Pipeline tools available in AWS.
• Experience building and deploying applications using the AWS CDK.
• Experience with Airflow, and with the administering and configuring Amazon Managed Workflows for Apache Airflow (MWAA).
• Experience in creating and deploying CloudFormation Templates (CFTs).
• Experience with Lifecycle Management of S3 Buckets.
• Clear Understanding of Cloud Databases Security involving AWS IAM Users and access, IAM Roles and Policies, Federated Users, and permissions.
• Good Understanding of AWS Encryption methodologies and AWS KMS Services.
• Experience with database performance testing and capacity planning.
• Working knowledge and experience with software development life cycle (SDLC) and agile/iterative methodologies.
• Knowledge of AWS Machine Learning Offerings, knowledge bases and Bedrock will be a plus.
• Application development and deployment experience with AWS, CI/CD pipelines, Git, and related techs.