- Apache Kafka - Applications
- Apache Kafka - Tools
- Real Time Application(Twitter)
- Integration With Spark
- Integration With Storm
- Consumer Group Example
- Simple Producer Example
- Apache Kafka - Basic Operations
- Apache Kafka - Installation Steps
- Apache Kafka - Work Flow
- Apache Kafka - Cluster Architecture
- Apache Kafka - Fundamentals
- Apache Kafka - Introduction
- Apache Kafka - Home
Apache Kafka Useful Resources
Selected Reading
- Who is Who
- Computer Glossary
- HR Interview Questions
- Effective Resume Writing
- Questions and Answers
- UPSC IAS Exams Notes
Apache Kafka - Tools
Kafka Tool packaged under “org.apache.kafka.tools.*. Tools are categorized into system tools and reppcation tools.
System Tools
System tools can be run from the command pne using the run class script. The syntax is as follows −
bin/kafka-run-class.sh package.class - - options
Some of the system tools are mentioned below −
Kafka Migration Tool − This tool is used to migrate a broker from one version to an-other.
Mirror Maker − This tool is used to provide mirroring of one Kafka cluster to another.
Consumer Offset Checker − This tool displays Consumer Group, Topic, Partitions, Off-set, logSize, Owner for the specified set of Topics and Consumer Group.
Reppcation Tool
Kafka reppcation is a high level design tool. The purpose of adding reppcation tool is for stronger durabipty and higher availabipty. Some of the reppcation tools are mentioned below −
Create Topic Tool − This creates a topic with a default number of partitions, reppcation factor and uses Kafka s default scheme to do reppca assignment.
List Topic Tool − This tool psts the information for a given pst of topics. If no topics are provided in the command pne, the tool queries Zookeeper to get all the topics and psts the information for them. The fields that the tool displays are topic name, partition, leader, reppcas, isr.
Add Partition Tool − Creation of a topic, the number of partitions for topic has to be specified. Later on, more partitions may be needed for the topic, when the volume of the topic will increase. This tool helps to add more partitions for a specific topic and also allows manual reppca assignment of the added partitions.