Logo
Diverse Lynx

Kafka Engineer

Diverse Lynx, Chicago, Illinois, United States, 60290


Role- Confluent Kafka Senior Developer/Architect

Location- Remote

Type- Fulltime

Job Description10+ years of experience in Enterprise Middleware, Microservices, designing and implementing APIs.5+ years of experience architecting, designing, implementing, operating a streaming platform based on Confluent Kafka.5+ Years of experience in Confluent platform or Confluent Cloud.5+ years of Java, Spring Boot experienceStrong fundamentals in distributed systems design and operations, microservice architecture, integration patternsDeep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architecturesEstablished track record with Kafka technology, with hands-on production experience and a deep understanding of the Kafka architecture and internals of how it works, along with interplay of architectural components: brokers, Zookeeper, producers/consumers, Kafka Connect, Kafka StreamsPractical experience with how to scale Kafka, KStreams, and Connector infrastructures.Experience with Kafka Streams / KSQL architecture and associated clustering model.Hands-on experience as a developer who has used the Kafka API to build producer and consumer applications, along with expertise in implementing KStreams components.Have developed KStreams pipelines, as well as deployed KStreams clusters.Experience with developing KSQL queries and best practices of using KSQL vs KStreamsStrong knowledge of the Kafka Connect framework, with experience using several connector types: HTTP REST proxy, JMS, File, SFTP, JDBC.Experience using Source/sink connectors asRDBMS, NoSQL data stores.Hands-on experience in designing, writing, and operationalizing new Kafka Connectors using the frameworkStrong familiarity of data formats such as XML, JSON, Avro, CSV, etc. along with serialization/deserialization optionsFamiliarity of the Schema RegistryExperience with monitoring Kafka infrastructure along with related components (Connectors, KStreams, and other producer/consumer apps)Familiarity with Confluent Control CenterFirm understanding of SDLC (systems development lifecycle)Excellent written and verbal communication skills.Excellent analytical and troubleshooting abilitiesPrior experience in banking / financial services industry and firm understanding of the banking data landscape.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.