Kafka單節點多Broker部署

2021-10-03 06:37:38 字數 2167 閱讀 9641

安裝好zookeeper並啟動服務

#broker的編號,必須是唯一的,相當於主鍵

broker.id=0

#每個broker監聽的埠

listeners=plaintext:/

/:9090

#日誌目錄,預設目錄在tmp下面,重啟後就會被清空,所以要重新指定乙個目錄

log.dirs=/root/kafka-tmp/log

#zookeeper位址

zookeeper.connect=hlsijx:2181

因為我們要建立三個broker,因此這個配置檔案也需要三份

server-1.properties

broker.id=1

listeners=plaintext:/

/:9091

log.dirs=/root/kafka-tmp/log-1

zookeeper.connect=hlsijx:2181

server-2.properties

broker.id=2

listeners=plaintext:/

/:9092

log.dirs=/root/kafka-tmp/log-2

zookeeper.connect=hlsijx:2181

server-3.properties

broker.id=3

listeners=plaintext:/

/:9093

log.dirs=/root/kafka-tmp/log-3

zookeeper.connect=hlsijx:2181

當前路徑:$kafka_home/config,執行命令:

$ kafka-server-

start

.sh -daemon server-1.properties &

$ kafka-server-

start

.sh -daemon server-2.properties &

$ kafka-server-

start

.sh -daemon server-3.properties &

啟動完成後可以看到有3個kafka程序

#建立乙個topic,名字叫my-replicated-topic,連線到zookeeper,3副本,1分割槽

kafka-topics.sh --create --zookeeper hlsijx:2181 --replication-factor 3 --partitions 1 --topic my-replicated-topic

執行完成後會提示「created topic 「my-replicated-topic」.」再來看一下topic的描述資訊:

kafka-topics.sh --describe --zookeeper hlsijx:2181 --topic my-replicated-topic
從圖中我們可以看到,當前的leader是2,副本在2,3,1上都有且三個節點都活著

生產訊息:

kafka-console-producer.sh --broker-list hlsijx:9091,hlsijx:9092,hlsijx:9093 --topic my-replicated-topic
消費訊息:

kafka-console-consumer.sh --bootstrap-server hlsijx:9091,hlsijx:9092,hlsijx:9093 --topic my-replicated-topic --

from

-beginning

Kafka單節點多broker配置

1 啟動zookeeper zkserver.sh start 2 配置多個broker 1.在kafka安裝目錄的config目錄下拷貝 server.properties 分別為server 1.properties,server 2.properties,server 3 properties...

kafka單節點多broker部署及使用

kafka單節點多broker部署及使用 將配置檔案server.properties複製三份 cp server.properties server 1.properties 更新配置檔案 server 1.properties 中引數 broker.id 1 listeners plaintex...

kafka集群部署,多節點多broker

主機名 ip 位址 安裝路徑 系統135.36.247.91 135.36.247.91 board opt kafka 2.11 1.0.0 centos linux release 7.3.1611 core 135.36.247.92 135.36.247.92 135.36.247.93 1...