Dice
AWS Data Engineer(Python, Pyspark)
Dice, Newark, New Jersey, us, 07175
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Techtriad Team - T3, is seeking the following. Apply via Dice today!Role: Data Engineer
Location: Newark, NY Hybrid
RTH: Yes
Job Description:
Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners.As a part of our CDO organization, you will work with our ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner.Qualifications:
Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experienceExperience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprisesAWS Solutions Architect or AWS Big Data Certification preferredProgramming experience with Java, Python/Scala, Shell scriptingSolid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.Solid experience implementing solutions on AWS based data lakesExperience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDBExperience in AWS data lake, data warehouse and business analyticsExperience in system analysis, design, development, and implementation of data ingestion pipeline in AWSKnowledge of ETL/ELTWorking experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desiredExperience working on Agile projectsRequirements:
3 - 5 years of experience as Data EngineerExperience developing business applications using NoSQL/SQL databasesExperience working with Object stores (S3) and JSON is must haveShould have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, ElasticSearchServerless application development using AWS LambdaResponsibilities:
Designing, building and maintaining efficient, reusable and reliable architecture and codeEnsure the best possible performance and quality of high scale web applications and servicesParticipate in the architecture and system design discussionsIndependently perform hands on development and unit testing of the applicationsCollaborate with the development team and build individual components into complex enterprise web systemsWork in a team environment with product, frontend design, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycleResponsible to identify and resolve any performance issuesKeep up to date with new technology development and implementationParticipate in code review to make sure standards and best practices are metPlus:
Experience with business intelligence tools such as Tableau, Power BI or equivalentAware of Machine learning algorithms (supervised/unsupervised)Nice to have AWS developer certificateAWS Data Engineer (Python, Pyspark)
#J-18808-Ljbffr
Location: Newark, NY Hybrid
RTH: Yes
Job Description:
Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners.As a part of our CDO organization, you will work with our ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner.Qualifications:
Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experienceExperience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprisesAWS Solutions Architect or AWS Big Data Certification preferredProgramming experience with Java, Python/Scala, Shell scriptingSolid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.Solid experience implementing solutions on AWS based data lakesExperience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDBExperience in AWS data lake, data warehouse and business analyticsExperience in system analysis, design, development, and implementation of data ingestion pipeline in AWSKnowledge of ETL/ELTWorking experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desiredExperience working on Agile projectsRequirements:
3 - 5 years of experience as Data EngineerExperience developing business applications using NoSQL/SQL databasesExperience working with Object stores (S3) and JSON is must haveShould have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, ElasticSearchServerless application development using AWS LambdaResponsibilities:
Designing, building and maintaining efficient, reusable and reliable architecture and codeEnsure the best possible performance and quality of high scale web applications and servicesParticipate in the architecture and system design discussionsIndependently perform hands on development and unit testing of the applicationsCollaborate with the development team and build individual components into complex enterprise web systemsWork in a team environment with product, frontend design, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycleResponsible to identify and resolve any performance issuesKeep up to date with new technology development and implementationParticipate in code review to make sure standards and best practices are metPlus:
Experience with business intelligence tools such as Tableau, Power BI or equivalentAware of Machine learning algorithms (supervised/unsupervised)Nice to have AWS developer certificateAWS Data Engineer (Python, Pyspark)
#J-18808-Ljbffr