Linux Kafka 集群安裝筆記

2021-08-02 13:51:56 字數 2841 閱讀 8117

環境:vmware workstation 10,centos-7-x86_64-***-1511.iso,xshell 4.0,ip1:192.168.216.138,ip2:192.168.216.139,ip3:192.168.216.140.

參照linux_zookeeper 安裝筆記準備一組zookeeper集群。

參照linux_kafka 安裝筆記在ip1,ip2和ip3上各安裝一台kafka,到下面這一步:

[root@localhost ~]# mv /usr/local/kafka_2.12-0.10.2.1/ /usr/local/kafka

ip1

[root@localhost ~]# vim /usr/local/kafka/config/server.properties

broker.id=1

listeners=plaintext:

advertised.listeners=plaintext:

log.retention.hours=168

message.max.byte=5242880

default.replication.factor=2

replica.fetch.max.bytes=5242880

zookeeper.connect=192.168.216.138:2181,192.168.216.139:2181,192.168.216.140:2181

ip2

[root@localhost ~]# vim /usr/local/kafka/config/server.properties

broker.id=2

listeners=plaintext:

advertised.listeners=plaintext:

log.retention.hours=168

message.max.byte=5242880

default.replication.factor=2

replica.fetch.max.bytes=5242880

zookeeper.connect=192.168.216.138:2181,192.168.216.139:2181,192.168.216.140:2181

ip3

[root@localhost ~]# vim /usr/local/kafka/config/server.properties

broker.id=3

listeners=plaintext:

advertised.listeners=plaintext:

log.retention.hours=168

message.max.byte=5242880

default.replication.factor=2

replica.fetch.max.bytes=5242880

zookeeper.connect=192.168.216.138:2181,192.168.216.139:2181,192.168.216.140:2181

ip1, ip2和ip3

注意:下面命令中「–」是兩個「-」,csdn顯示有誤。

[root@localhost ~]# firewall-cmd –zone=public –add-port=9092/tcp –permanent

success

[root@localhost ~]# firewall-cmd –reload

success

[root@localhost ~]# /usr/local/kafka/bin/kafka-server-start.sh -daemon /usr/local/kafka/config/server.properties

ip1

[root@localhost ~]# /usr/local/kafka/bin/kafka-topics.sh –create –zookeeper localhost:2181 –replication-factor 2 –partitions 1 –topic test

[root@localhost ~]# /usr/local/kafka/bin/kafka-console-producer.sh –broker-list 192.168.216.138:9092 –topic test

ip2

[root@localhost ~]# /usr/local/kafka/bin/kafka-console-consumer.sh –bootstrap-server 192.168.216.139:9092 –topic test –from-beginning

ip3

[root@localhost ~]# /usr/local/kafka/bin/kafka-console-consumer.sh –bootstrap-server 192.168.216.140:9092 –topic test –from-beginning

然後在ip1上生產訊息,ip2和ip3消費訊息。

LINUX kafka 集群安裝

1 準備工作 2 開始安裝 kafka 壓縮包上傳到伺服器上 tmp 上 2 解壓 kafka 的安裝包 3 把kafka包移動到目錄 usr local mv kafka 2.11 0.9.0.1 usr local 4 配置 kafka 環境變數 可選 vi etc profile 在profi...

linux kafka 安裝與啟動

cp kafka 2.12 2.1.1.tgz opt 然後解壓 tar zxvf kafka 2.12 2.1.1.tgz 2.環境變數配置 可以選做 vim etc profile 3.設定單機啟動 修改配置檔案 修改日誌路徑 log.dirs opt kafka 2.12 2.1.1 zook...

Mac cuda tensorflow安裝筆記

第一步,安裝anaconda 鏈結是基本上是一鍵安裝,過程簡單。第二步,mac的終端,用conda命令建立tensorflow環境並啟用 建立環境 conda create n tensorflow pip python 2.7 啟用 source activate tensorflow 環境啟用後...