ConsultNet
Big Data Engineer
ConsultNet, Mc Lean, Virginia, us, 22107
Senior Data EngineerRemote- must work standard EST hoursLong term contract/ contract to hire
Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data Engineer role supports data delivery, serving, design, monitoring, and security management for data science, graph, and machine learning engineering teams.
Requirements• 7+ years of relevant experience• Demonstrable AWS knowledge - EC2, ECS, Lambda, S3, EMR• Strong programming ability in Python or Scala• Experience with SQL and relational data• 3+ years experience in one or more big data technology : S3, HDFS, Spark, Presto, etc. SPARK preferred• Experience designing and implementing ETL pipelines to support Data Science and/or Machine Learning.
Nice to have• Feature Store build experience and Dagster• Financial industry experience
Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data Engineer role supports data delivery, serving, design, monitoring, and security management for data science, graph, and machine learning engineering teams.
Requirements• 7+ years of relevant experience• Demonstrable AWS knowledge - EC2, ECS, Lambda, S3, EMR• Strong programming ability in Python or Scala• Experience with SQL and relational data• 3+ years experience in one or more big data technology : S3, HDFS, Spark, Presto, etc. SPARK preferred• Experience designing and implementing ETL pipelines to support Data Science and/or Machine Learning.
Nice to have• Feature Store build experience and Dagster• Financial industry experience