1.kafka監控kafka-manager:
2.啟動kafka
## 啟動zookeeper
bin/zkserver.sh start
## 開啟zk客戶端查詢
bin/zkcli.sh -server dsjcx1:2181,dsjcx2:2181,dsjcx3:2181
## 啟動kafka
bin/kafka-server-start.sh -daemon ./config/server.properties
## 現在kafka的消費者offser都存在topic為__consumer_offsets中
3.kafka基本操作
## create topic
sh /kafka/bin/kafka-topics.sh --create --zookeeper dsjcx1:2181,dsjcx2:2181,dsjcx3:2181/kafka --replication-factor 2 --partitions 1 --topic flink-pause-topic
## producer
sh /kafka/bin/kafka-console-producer.sh --broker-list dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --topic test0916
sh /kafka/bin/kafka-console-producer.sh --broker-list dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --topic testtd < testtd.json
## consumer
sh /kafka/bin/kafka-console-consumer.sh --bootstrap-server dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --topic flink-pause-topic
sh /kafka/bin/kafka-console-consumer.sh --bootstrap-server dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --from-beginning --topic test123 > test123.json
sh /kafka/bin/kafka-console-consumer.sh --bootstrap-server dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --topic test123 --partition 0 --offset 6269200 > test123.json
## offset 分割槽：最小值 分割槽：最大值 其中最大值為當前offset
sh /kafka/bin/kafka-run-class.sh kafka.tools.getoffsetshell --broker-list dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --topic test --time -2
sh /kafka/bin/kafka-run-class.sh kafka.tools.getoffsetshell --broker-list dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --topic test --time -1
## offset提交情況(新舊版本的命令)
bin/kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server localhost:9092 --formatter "kafka.coordinator.groupmetadatamanager\$offsetsmessageformatter" --consumer.config config/consumer.properties
bin/kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server localhost:9092 --formatter "kafka.coordinator.group.groupmetadatamanager\$offsetsmessageformatter" --consumer.config config/consumer.properties
## 檢視topic
sh /kafka/bin/kafka-topics.sh --list --zookeeper dsjcx1:2181,dsjcx2:2181,dsjcx3:2181/kafka
## 檢視topic詳細
sh /kafka/bin/kafka-topics.sh --describe --zookeeper dsjcx1:2181,dsjcx2:2181,dsjcx3:2181/kafka --topic test123
## 刪除topic
sh /kafka/bin/kafka-topics.sh --zookeeper dsjcx1:2181,dsjcx2:2181,dsjcx3:2181/kafka --delete --topic test123
## 檢視consumer
sh /kafka/bin/kafka-consumer-groups.sh --new-consumer --bootstrap-server dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --list
sh /kafka/bin/kafka-consumer-groups.sh --new-consumer --bootstrap-server dsjcx1:9092,dsjcx2:9092,dsjcx3:9092 --group sx_bank_flink_project --describe
sh /kafka/bin/kafka-consumer-groups.sh --zookeeper dsjcx1:2181,dsjcx2:2181,dsjcx3:2181/kafka --list
sh /kafka/bin/kafka-consumer-groups.sh --zookeeper dsjcx1:2181,dsjcx2:2181,dsjcx3:2181/kafka --group sx_bank_flink_project
## 完全刪除topic及資料
1.如果配置了delete.topic.enable=true
1.1 sh /kafka/bin/kafka-topics.sh --zookeeper dsjcx1:2181,dsjcx2:2181,dsjcx3:2181/kafka --delete --topic test
1.2 zookeeper上執行rmr /kafka/brokers/topics/test
1.3 刪除kafka的資料目錄 rm -rf /tmp/kafka-log/test-*
如果想重新建這個topic，必須重啟kafka再重建，否則新建的topic會marked for deletion
kafka 常用操作
kafka支援的基本命令位於 bin資料夾中 常用命令 kafka topics.shkafka console consumer.shkafka console producer.sh kafka命令參考頁面 kafka 0.8.x 幫助文件 檢視topic列表 kafka topics list...
kafka常用操作
1.開啟zookeeper命令 備註 先進入zookeeper的bin目錄 zkserver.sh start 2.關閉zookeeper命令 備註 先進入zookeeper的bin目錄 zkserver.sh stop 3.kafka啟動命令 備註 先進入kafka目錄 常規模式啟動kafka b...
kafka常用操作命令
broker kafka集群由乙個或多個伺服器組成。每個伺服器稱為 主題 topic 維護一組訊息分類 分割槽 partition 隸屬於主題，每個主題會包含多個分割槽，訊息 msg 隸屬於分割槽，每個分割槽有乙個訊息序列，每個訊息在該分割槽中都有乙個唯一的序號，這個序號叫偏移量 生產者 produ...