6 to 8 Years Relevant Experience
We are looking for an experienced Kafka Administrator with strong expertise in managing and supporting Kafka infrastructure and Unix systems. The ideal candidate will ensure the availability, performance, and security of Kafka clusters, while also developing automation and supporting integration with other systems.
Key Responsibilities:
- Administer and maintain Kafka infrastructure, ensuring high availability, scalability, and performance.
- Perform end-to-end Kafka administration, including installation, configuration, upgrades, and patching.
- Develop and manage Kafka-based data pipelines to support enterprise-level data ingestion and processing.
- Create and manage Kafka topics, producers, and consumers, including Python-based implementations to enable seamless data exchange between systems.
- Automate Kafka operational tasks using scripting and configuration management tools.
- Monitor Kafka clusters proactively and optimize performance, latency, and throughput.
- Troubleshoot and resolve Kafka-related issues across environments.
- Perform Unix system administration tasks relevant to Kafka deployments and integrations.
- Collaborate with development, DevOps, and data engineering teams to support integration and infrastructure needs.
- Handle customer support queries and provide timely resolutions for Kafka-related incidents.
Preferred Qualifications and Skills:
- Strong hands-on experience with Apache Kafka administration in production environments.
- Proficient in Unix/Linux environments, including scripting (Shell, Python).
- Experience with Kafka ecosystem tools (e.g., Kafka Connect, Schema Registry, Kafka Streams).
- Familiarity with automation tools such as Ansible, Puppet, or Chef.
- Experience integrating Kafka with big data technologies like Hadoop, Spark, and Storm.
- Solid understanding of data streaming architectures and real-time data processing.
- Strong analytical, problem-solving, and communication skills.
Nice to Have:
- Knowledge of cloud-based Kafka services (e.g., Confluent Cloud, AWS MSK).
- Exposure to containerization tools like Docker and orchestration tools like Kubernetes.
- Experience with monitoring tools such as Prometheus, Grafana, or ELK stack for Kafka observability.