Qualitative Financials
Role: Streaming/Batch Infrastructure Engineer
Qualitative Financials, San Francisco, California, United States, 94199
Role: Streaming/Batch Infrastructure Engineer
Locations: Remote (San Francisco, CA) Once in a quarter they need to Visit San Francisco, CA
Duration: Contract/Fulltime
Job Description:
4+ years of professional experience in Stream/Batch Processing systems at scale. Strong Programming skills in Java, Python. Experience in Public Cloud is a must. Experience with GCP and GCP managed services is a strong plus. i. Experience in Messaging/Stream Processing systems on Cloud such as Pub/Sub, Kafka, Kinesis, DataFlow, Flink etc, and/Or ii. Experience in Batch Processing systems such as Hadoop, Pig, Hive, Spark. Experience with Dataproc is a strong plus. Knowledge of DevOps principles and tools (e.g. CI/CD, IaC/Terraform). Strong understanding of Containerization technologies (e.g., Docker, Kubernetes). Strong problem-solving and critical thinking skills. Strong written/verbal communication skills with the ability to thrive in a remote work environment (For Senior leads/architects) Ability to explore new areas/problems as well as design and architect scalable solutions in Stream/Batch Processing at scale. Ability to technically lead a team of engineers on a project/component.
Locations: Remote (San Francisco, CA) Once in a quarter they need to Visit San Francisco, CA
Duration: Contract/Fulltime
Job Description:
4+ years of professional experience in Stream/Batch Processing systems at scale. Strong Programming skills in Java, Python. Experience in Public Cloud is a must. Experience with GCP and GCP managed services is a strong plus. i. Experience in Messaging/Stream Processing systems on Cloud such as Pub/Sub, Kafka, Kinesis, DataFlow, Flink etc, and/Or ii. Experience in Batch Processing systems such as Hadoop, Pig, Hive, Spark. Experience with Dataproc is a strong plus. Knowledge of DevOps principles and tools (e.g. CI/CD, IaC/Terraform). Strong understanding of Containerization technologies (e.g., Docker, Kubernetes). Strong problem-solving and critical thinking skills. Strong written/verbal communication skills with the ability to thrive in a remote work environment (For Senior leads/architects) Ability to explore new areas/problems as well as design and architect scalable solutions in Stream/Batch Processing at scale. Ability to technically lead a team of engineers on a project/component.