部署3個節點的Kafka偽分布式集群

在部署3個節點的zookeeper偽分布式集群這篇文章的基礎上，部署3個節點的kafka偽分布式集群

kafka集群不需要像zookeeper集群似的拷貝多份程式，只需要啟動時指定不同的配置檔案即可，只需要乙份程式

cd /opt/

wget

2、解壓並重命名

tar -zxvf kafka_2.12-2.1.0.tgz

mv kafka_2.12-2.1.0 kafka

3、修改配置檔案

vi kafka/config/server.properties broker.id=0 listeners=plaintext://伺服器ip:9092 log.dirs=/opt/data/kafka/kafka-logs-1 delete.topic.enable=true zookeeper.connect=localhost:2181,localhost:2182,localhost:2183 mv kafka/config/server1.properties cp kafka/config/server1.properties kafka/config/server2.properties cp kafka/config/server1.properties kafka/config/server3.properties vi kafka/config/server2.properties broker.id=1 listeners=plaintext://伺服器ip:9093 log.dirs=/opt/data/kafka/kafka-logs-2 delete.topic.enable=true zookeeper.connect=localhost:2181,localhost:2182,localhost:2183 vi kafka/config/server3.properties broker.id=2 listeners=plaintext://伺服器ip:9094 log.dirs=/opt/data/kafka/kafka-logs-3 delete.topic.enable=true

zookeeper.connect=localhost:2181,localhost:2182,localhost:2183

4、分別啟動kafka3個節點

cd kafka/ ./bin/kafka-server-start.sh config/server1.properties & ./bin/kafka-server-start.sh config/server2.properties &

./bin/kafka-server-start.sh config/server3.properties &

5、如果啟動過程中因為記憶體不足，啟動失敗，可以修改kafka啟動時jvm堆記憶體大小

vi /opt/kafka/bin/kafka-server-start.sh

將如下**中1g改為512m

if [ "x$kafka_heap_opts" = "x" ]; then
export kafka_heap_opts="-xmx1g -xms1g"
fi

if [ "x$kafka_heap_opts" = "x" ]; then
export kafka_heap_opts="-xmx512m -xms512m"
fi

再次啟動即可

部署3個節點的Kafka偽分布式集群

kafka單節點單broker的安裝部署及使用

kafka的配置和分布式部署

CentOS7安裝3節點的kafka

部署3個節點的Kafka偽分布式集群

kafka單節點單broker的安裝部署及使用

kafka的配置和分布式部署

CentOS7安裝3節點的kafka

相關推薦