Technogen International Company
AWS Data Engineer
Technogen International Company, Richmond, VA
Title: Data Engineer - Sr
Location: Richmond, VA or Mclean, VA
Duration: 6 Months
JOB DESCRIPTION-
Sr Data Engineer
Responsibilities:
Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant data Pipelines that provides meaningful and timely insights
Build the next generation Distributed Data Pipelines using programming languages like Python
Be part of a group of engineers building data pipelines using big data technologies (Spark, Snowflake, AWS Big Data Services like Glue) on medium to large scale datasets
Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
Collaborate with digital product managers, and deliver robust cloud-based solutions.
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Preferred Skills:
AWS (EMR, EC2, Glue, Lambda, S3), Spark, Python, Databricks
3+ years of experience in application development including Python, SQL
2+ years of experience with a public cloud (AWS)
3+ years experience with Distributed data computing tools (Spark)
3+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices
Location: Richmond, VA or Mclean, VA
Duration: 6 Months
JOB DESCRIPTION-
Sr Data Engineer
Responsibilities:
Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant data Pipelines that provides meaningful and timely insights
Build the next generation Distributed Data Pipelines using programming languages like Python
Be part of a group of engineers building data pipelines using big data technologies (Spark, Snowflake, AWS Big Data Services like Glue) on medium to large scale datasets
Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
Collaborate with digital product managers, and deliver robust cloud-based solutions.
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Preferred Skills:
AWS (EMR, EC2, Glue, Lambda, S3), Spark, Python, Databricks
3+ years of experience in application development including Python, SQL
2+ years of experience with a public cloud (AWS)
3+ years experience with Distributed data computing tools (Spark)
3+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices