Logo
Tata Consultancy Services

Kafka Engineer

Tata Consultancy Services, Dallas, TX, United States


Job Description

Job Type: Fulltime

Location: Dallas TX (Onsite)

Experience: 6+years

  • Looking for Developer with Confluent Kafka and System Integration experience to design, configure, build, and maintain a Multi-Platform Shared Enterprise Event Messaging Ecosystem on premise and in the public cloud.
  • You will work with new technology, build new solutions, and help our team and business partners, view technology as a solution to advance our consumer engagement and best in class experience.
  • Lead on Kafka Capacity planning, installation, administration/Platform management, performance optimization of Kafka partitioning and Kafka brokers.
  • Work on Kafka Cluster, Partitions, Security, Disaster recovery, Data pipeline, Data replication.
  • Work on building producer applications for Kafka and Configuration in Confluent Kafka.
  • Work in tuning Kafka partitioning. Performance optimization with Kafka brokers.
  • Work on configuring Self-Managed Kafka connectors
  • Work on Deploying confluent Kafka cluster which includes Installation, Configuration, Deployment, Securing, Monitoring and Troubleshooting
  • Work on administrating confluent Kafka
  • Work on optimization of Kafka cluster using performance tuning at different levels (Producer, broker, and consumer).
  • Work on monitoring Kafka Services, Topics and Partitions all are up and running
  • Work on setting up monitoring alerts for multiple metrics
  • Design, support and deploy mechanisms to enhance, refine, and deliver the architecture vision
  • Analyze current information technology environments to identify and assess critical capabilities and recommend solutions
  • Provide research and development activities for architecture
  • Collaborate with Project Managers and technical leads to provision estimates, develop overall implementation solution plan, and serve as a lead as required. Provide lab and vendor support
  • Provide guidance for enterprise-wide technology to junior staff
  • Develop frameworks, standards & reference material for architecture and associated products
  • Develop & maintain common services, repositories & utility components for the enterprise
  • Provide data, application & technology deliverables on a program & project level basis including risk & opportunity assessment, modeling and design related products and services
  • Effectively communicate the architecture to all levels of the organization
  • Adhere to enterprise architecture strategies, principals, standards, policies and procedures.