Logo
Saxon Global

Sr. Data Engineer

Saxon Global, Chicago, Illinois, United States, 60290


CAPITAL ONECHICAGO IL (onsite 3 days week)

REQ ID 73155-1

Sr Data Engineer

We are seeking an experienced data engineer to contribute to a high data volume application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (ML) and Master Data applications. In the future, there's a plan to migrate the existing AWS EMR application to AWS Glue.

The ideal candidate will possess robust data engineering expertise, adept at designing, developing, and fine-tuning applications. Exposure to various design patterns within the data engineering paradigm is crucial for success in this role.

Our development process adheres to an agile methodology, with Program Increment (PI) planning occurring every six weeks, equivalent to three sprints. If you are a skilled data engineer who thrives in an agile environment and has a solid background in designing and optimizing applications, we invite you to join our dynamic team.

Skill Set:

AWS Cloud Technologies:Strong command of Apache Spark (3-5 years)AWS EMR proficiency (3-5 years)AWS Glue expertise (1-5 years)PySpark Application Development:

Extensive experience in designing, developing, troubleshooting, and debugging PySpark applicationsProven track record in processing and handling large datasetsPerformance Tuning:

Hands-on experience in performance tuning Spark applicationsSkills to optimize Spark code for scalability, performance, and maintainabilityMicroservices Development:

Proficient in developing microservices using AWS Lambda, SNS, DynamoDB (1-5 years)Code Management:Strong proficiency in using GitHub for efficient code management and sharingNice to have:

Experience in the node.js, vue.js.Experience in Databricks

Required Skills : AWS EMR AWS Glue AWS Lambda AWS SNS DynamoDB Apache Spark PySpark / Python CodingNo Tenure Limit PolicyBackground Check :YesNotes :Selling points for candidate :No Tenure Limit PolicyProject Verification Info :"The information provided below is for Apex Systems AV use only and is not to be distributed publicly, or to any third party. Any distribution of the below information will result in corrective action from Apex Systems Vendor Management. MSA: Blanket Approval Received Client Letter: Will Provide"Candidate must be your W2 Employee :YesExclusive to Apex :YesFace to face interview required :NoCandidate must be local :NoCandidate must be authorized to work without sponsorship ::NoInterview times set :YesType of project :Master Job Title :Branch Code :