Get new jobs for this search by email

Job – Senior Platform Engineer Location: Concord, CA Job Overview: We’re seeking a Senior Platform Engineer with deep expertise in event-driven architectures, particularly leveraging Apache Kafka and Apache Flink, to help design, build, and scale our next-generation streaming platform. You will be a technical leader responsible for the architecture, scalability, and reliability of real-time data pipelines that power mission-critical services across the organization. This role involves close collaboration with software engineers, data scientists, and infrastructure teams to deliver highly available, observable, and scalable systems. The ideal candidate will bring hands-on expertise in Kubernetes, cloud-native services (AWS, GCP, or Azure), and infrastructure as code (IaC) to optimize orchestration, deployment, and resilience in a dynamic environment. Key Responsibilities: Design and implement scalable, fault-tolerant streaming data platforms using Apache Kafka and Apache Flink. Lead architectural decisions and define best practices for real-time event-driven data processing. Develop and maintain self-service tools to enable internal teams to consume, process, and produce streaming data. Optimize performance, reliability, and observability in Kubernetes-based environments. Drive adoption of IaC practices using tools like Terraform, Pulumi, and Helm. Collaborate with analytics, ML, and engineering teams on end-to-end data enablement. Improve cost-efficiency and system resilience across AWS, GCP, or Azure environments. Mentor junior engineers and influence the long-term technical roadmap. Required Qualifications: 7+ years of experience in platform/backend engineering with a focus on distributed systems. Deep hands-on experience with Apache Kafka (Kafka Streams, Connect) and Apache Flink (DataStream API, CEP, state management). Solid experience in Kubernetes for workload orchestration and scaling. Strong programming skills in Java, Scala, or Python. Experience with observability stacks like Prometheus, Grafana, and OpenTelemetry. Skilled in cloud services (AWS, GCP, Azure) and infrastructure automation tools like Terraform or Pulumi. Strong communication and collaboration skills with the ability to drive cross-team technical initiatives. Preferred: Prior experience in streaming analytics, real-time monitoring, or data lake integrations. Experience with CI/CD pipelines, Helm charts, and DevOps automation.