TechnoGen
Senior Data Engineer
TechnoGen, New York, New York, us, 10261
Please Note: As of July 22, 2021, our team will require that all candidate submissions include a LinkedIn profile. Please do not submit any candidates that do not have a LinkedIn.
Kforce has a client in Brooklyn, NY that is seeking a Senior Data Engineer. Our team is headquartered in Brooklyn but has a remote-first culture and we encourage remote applicants - no preference in time zone. This is a 9-month full-time contractor position reporting to the Engineering Manager, Data Platform. Summary: As a member of our Data Infrastructure team, the Senior Data Engineer will help us build and maintain tools and infrastructure to write, test, and schedule batch data pipelines. Their work will enable other developers, data scientists, and analysts to write the high-performing pipelines that power data science, machine learning, and product development. We primarily write in Scala, Java, and Python and use technologies like Hadoop, Spark, Airflow, Terraform, and Kubernetes, as well as GCP services like Dataproc, Dataflow, and BigQuery. We build highly-performant systems that are maintainable and easy to understand by selecting and integrating with the best of current technologies. We develop robust, highly available, well-monitored data infrastructure. We stay in close communication with our internal customers and make strategic improvements to ensure those that depend on us have a great experience using data. The Senior Data Engineer should have experience building data processing platforms, supporting them at scale, and collaborating with other teams that depend on them. Experience building applications and managing infrastructure using one of the major cloud providers is preferred but not required. We value curiosity, passion, responsibility, and generosity of spirit.
Required Skills : * Understand that being an effective software engineer is about communicating with people as much as it is about writing code * Willing to work with and improve code you did not originally write * Generous with your time and experience, and can mentor and learn from other engineers * Can tackle unconstrained problems and know when to seek help * Strong domain expertise and backend skills (working in Scala, Java and Python) * Strong leadership and communication skills * Experience collaborating with other engineers and product teams Experience with the following: * Advantages and limitations of distributed systems * DevOps * Writing ETL pipelines * Building and monitoring cloud services (GCP services preferred) and infrastructure * Using or maintaining data processing environments like Hadoop, Spark, PySpark, and Dataflow. * Preference for candidates that have experience working with AirflowBasic Qualification :Additional Skills :
candidates that have prior experience in staff-level engineer roles and their resume clearly demonstrates leadership experience. Though we are looking for a Data engineer with prior experience in writing data pipelines, we're also looking for a candidate that has infrastructure/DevOps experience/skillset.Rank :A3Requested Date :2023-03-08
Kforce has a client in Brooklyn, NY that is seeking a Senior Data Engineer. Our team is headquartered in Brooklyn but has a remote-first culture and we encourage remote applicants - no preference in time zone. This is a 9-month full-time contractor position reporting to the Engineering Manager, Data Platform. Summary: As a member of our Data Infrastructure team, the Senior Data Engineer will help us build and maintain tools and infrastructure to write, test, and schedule batch data pipelines. Their work will enable other developers, data scientists, and analysts to write the high-performing pipelines that power data science, machine learning, and product development. We primarily write in Scala, Java, and Python and use technologies like Hadoop, Spark, Airflow, Terraform, and Kubernetes, as well as GCP services like Dataproc, Dataflow, and BigQuery. We build highly-performant systems that are maintainable and easy to understand by selecting and integrating with the best of current technologies. We develop robust, highly available, well-monitored data infrastructure. We stay in close communication with our internal customers and make strategic improvements to ensure those that depend on us have a great experience using data. The Senior Data Engineer should have experience building data processing platforms, supporting them at scale, and collaborating with other teams that depend on them. Experience building applications and managing infrastructure using one of the major cloud providers is preferred but not required. We value curiosity, passion, responsibility, and generosity of spirit.
Required Skills : * Understand that being an effective software engineer is about communicating with people as much as it is about writing code * Willing to work with and improve code you did not originally write * Generous with your time and experience, and can mentor and learn from other engineers * Can tackle unconstrained problems and know when to seek help * Strong domain expertise and backend skills (working in Scala, Java and Python) * Strong leadership and communication skills * Experience collaborating with other engineers and product teams Experience with the following: * Advantages and limitations of distributed systems * DevOps * Writing ETL pipelines * Building and monitoring cloud services (GCP services preferred) and infrastructure * Using or maintaining data processing environments like Hadoop, Spark, PySpark, and Dataflow. * Preference for candidates that have experience working with AirflowBasic Qualification :Additional Skills :
candidates that have prior experience in staff-level engineer roles and their resume clearly demonstrates leadership experience. Though we are looking for a Data engineer with prior experience in writing data pipelines, we're also looking for a candidate that has infrastructure/DevOps experience/skillset.Rank :A3Requested Date :2023-03-08