Difference between revisions of "Kafka Cheat Sheet"
Jump to navigation
Jump to search
(Created page with "'''How to List Kafka Topics''' Syntac : $ kafka-topics.sh --zookeeper [zookeeper-node]:2181 --list Eg : $ kafka-topics.sh --zookeeper de-devcluster2-kafka-vm-0:2181 --li...") |
|||
| Line 8: | Line 8: | ||
$ kafka-topics.sh --zookeeper de-devcluster2-kafka-vm-0:2181 --list | grep TestTopic | $ kafka-topics.sh --zookeeper de-devcluster2-kafka-vm-0:2181 --list | grep TestTopic | ||
| + | |||
| + | '''How to Describe Kafka Topics''' | ||
| + | |||
| + | Syntac : | ||
| + | |||
| + | $ kafka-topics.sh --zookeeper [zookeeper-node]:2181 --describe --topic [topic-name] | ||
| + | |||
| + | Eg : | ||
| + | |||
| + | $ kafka-topics.sh --zookeeper de-devcluster2-kafka-vm-0:2181 --describe --topic TestDevOps1Topic | ||
| + | |||
| + | |||
| + | '''How to Produce Message to Topic''' | ||
| + | |||
| + | Syntac : | ||
| + | |||
| + | $ echo "[Message Content]" | kafka-console-producer.sh --broker-list [broker-node]:9092 --topic [topic-name] | ||
| + | |||
| + | Eg : | ||
| + | |||
| + | $ echo "Test Message 5" | kafka-console-producer.sh --broker-list de-devcluster2-kafka-vm-0:9092 --topic TestDevOps1Topic | ||
| + | |||
| + | |||
| + | '''How to Consume Message from Topic''' | ||
| + | |||
| + | Syntac : | ||
| + | |||
| + | $ kafka-console-consumer.sh --bootstrap-server [bootstrap-node]:9092 --topic [topic-name] --from-beginning | ||
| + | |||
| + | Eg : | ||
| + | |||
| + | $ kafka-console-consumer.sh --bootstrap-server de-devcluster2-kafka-vm-0:9092 --topic TestDevOps1Topic --from-beginning | ||
| + | |||
| + | |||
| + | '''How to Check Topics Offset''' | ||
| + | |||
| + | Syntac : | ||
| + | |||
| + | $ kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list [broker-node]:9092 --time -1 --topic [topic-name] | ||
| + | |||
| + | Eg : | ||
| + | |||
| + | $ kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list de-devcluster2-kafka-vm-0:9092 --time -1 --topic rndtest1.datafabric.storage.egestion | ||
Revision as of 09:46, 24 November 2020
How to List Kafka Topics
Syntac :
$ kafka-topics.sh --zookeeper [zookeeper-node]:2181 --list
Eg :
$ kafka-topics.sh --zookeeper de-devcluster2-kafka-vm-0:2181 --list | grep TestTopic
How to Describe Kafka Topics
Syntac :
$ kafka-topics.sh --zookeeper [zookeeper-node]:2181 --describe --topic [topic-name]
Eg :
$ kafka-topics.sh --zookeeper de-devcluster2-kafka-vm-0:2181 --describe --topic TestDevOps1Topic
How to Produce Message to Topic
Syntac :
$ echo "[Message Content]" | kafka-console-producer.sh --broker-list [broker-node]:9092 --topic [topic-name]
Eg :
$ echo "Test Message 5" | kafka-console-producer.sh --broker-list de-devcluster2-kafka-vm-0:9092 --topic TestDevOps1Topic
How to Consume Message from Topic
Syntac :
$ kafka-console-consumer.sh --bootstrap-server [bootstrap-node]:9092 --topic [topic-name] --from-beginning
Eg :
$ kafka-console-consumer.sh --bootstrap-server de-devcluster2-kafka-vm-0:9092 --topic TestDevOps1Topic --from-beginning
How to Check Topics Offset
Syntac :
$ kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list [broker-node]:9092 --time -1 --topic [topic-name]
Eg :
$ kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list de-devcluster2-kafka-vm-0:9092 --time -1 --topic rndtest1.datafabric.storage.egestion
