Data Engineer

Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders, and partners. As a part of our organization, you will work with our Client Engineers, Data Scientists, and various BUs to define solutions for operationalizing data-driven decision making in a cost-effective and scalable manner.Qualifications:Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent combination of education and experienceExperience implementing, supporting data lakes, data warehouses, and data applications on AWS for large enterprisesAWS Solutions Architect or AWS Big Data Certification preferredProgramming experience with Java, Python/Scala, Shell scriptingSolid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, etc.Solid experience implementing solutions on AWS-based data lakesExperience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDBExperience in AWS data lake, data warehouse, and business analyticsExperience in system analysis, design, development, and implementation of data ingestion pipeline in AWSKnowledge of ETL/ELTWorking experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desiredExperience working on Agile projectsRequirements:3 - 5 years of experience as Data EngineerExperience developing business applications using NoSQL/SQL databasesExperience working with Object stores (S3) and JSON is a must-haveShould have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, ElasticSearchServerless application development using AWS LambdaResponsibilities:Designing, building, and maintaining efficient, reusable, and reliable architecture and codeEnsure the best possible performance and quality of high-scale web applications and servicesParticipate in the architecture and system design discussionsIndependently perform hands-on development and unit testing of the applicationsCollaborate with the development team and build individual components into complex enterprise web systemsWork in a team environment with product, frontend design, production operation, QE/QA, and cross-functional teams to deliver a project throughout the whole software development cycleResponsible for identifying and resolving any performance issuesKeep up to date with new technology development and implementationParticipate in code reviews to ensure standards and best practices are metPlus:Experience with business intelligence tools such as Tableau, Power BI, or equivalentAware of Machine learning algorithms (supervised/unsupervised)Nice to have AWS developer certificate

#J-18808-Ljbffr