Linux下安裝Kafka單機偽集群

前提：已安裝zookeeper，參考：

> tar -xf kafka_2.12-2.3.0.tgz

# 9090節點

broker.id=0
listeners=plaintext://*.*.*.*:9090
advertised.listeners=plaintext:
log.dirs=/owl/log/kafka-2.0.0/9090
zookeeper.connect=0.0.0.0:2180

# 9091節點

broker.id=1
listeners=plaintext://*.*.*.*:9091
advertised.listeners=plaintext:
log.dirs=/owl/log/kafka-2.0.0/9091
zookeeper.connect=0.0.0.0:2181

# 9092節點

broker.id=2
listeners=plaintext://*.*.*.*:9092
advertised.listeners=plaintext:
log.dirs=/owl/log/kafka-2.0.0/9092
zookeeper.connect=0.0.0.0:2182

# start_9090.sh

cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-server-start.sh ./config/server.properties &
# start_9091.sh
cd /owl/soft/kafka-2.3.0/9091
./bin/kafka-server-start.sh ./config/server.properties &
# start_9092.sh
cd /owl/soft/kafka-2.3.0/9092
./bin/kafka-server-start.sh ./config/server.properties &
# start_cluster.sh 
cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-server-start.sh ./config/server.properties &
cd /owl/soft/kafka-2.3.0/9091
./bin/kafka-server-start.sh ./config/server.properties &
cd /owl/soft/kafka-2.3.0/9092
./bin/kafka-server-start.sh ./config/server.properties &
# stop_9090.sh 
cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-server-stop.sh
# stop_9091.sh 
cd /owl/soft/kafka-2.3.0/9091
./bin/kafka-server-stop.sh
# stop_9092.sh 
cd /owl/soft/kafka-2.3.0/9092
./bin/kafka-server-stop.sh
# stop_cluster.sh 
cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-server-stop.sh
cd /owl/soft/kafka-2.3.0/9091
./bin/kafka-server-stop.sh
cd /owl/soft/kafka-2.3.0/9092
./bin/kafka-server-stop.sh

> ./start_cluster.sh

broker.id=相應節點的broker.id

> ./conn_cluster.sh 

[zk: ****:2180,****:2181,****:2182(connected) 0] ls /brokers/ids
[0, 1, 2] 
# 節點啟動正常

# create_topic_9090.sh 主題建立

cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2180 --replication-factor 1 --partitions 1 --topic $1
echo "獲取已發布主題："
./bin/kafka-topics.sh --list --zookeeper 127.0.0.1:2180
# describe_topic_9090.sh 主題描述
cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-topics.sh --describe --zookeeper 127.0.0.1:2180 --topic $1
# publish_message_9090_topic.sh 訊息發布
cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-console-producer.sh --broker-list 127.0.0.1:9090 --topic $1
# subscribe_message_9090_topic.sh 訊息訂閱
cd /owl/soft/kafka-2.3.0/9090
./bin/kafka-console-consumer.sh --bootstrap-server 127.0.0.1:9090 --topic $1 --from-beginning

> ./create_topic_9090.sh test-topic

...created topic test-topic.
...獲取已發布主題：
...test-topic

> ./describe_topic_9090.sh test-topic

topic:test-topic partitioncount:1 replicationfactor:1 configs:
topic: test-topic partition: 0 leader: 1 replicas: 1 isr: 1

> ./publish_message_9090_topic.sh test-topic

>hello
>hi

> ./subscribe_message_9090_topic.sh test-topic

hello
hi

kafka 安裝（單機模式）

1.準備安裝包 上傳到目錄 opt kafka 解壓 tar zxvf kafka 2.12 1.0.0.tgz 2.修改配置檔案 config server.properties 引數預設值 參考數值 broker.id00 port 9092 9092 log.dirs tmp kafka lo...

kafka 學習（二）單機安裝kafka

參考 解壓後2.3.0才是kafka版本 2.12是kafka依賴的scala版本 kafka 2.12 2.3.0 kafka依賴於zookeeper 需安執行zookeeper，才能執行kafka kafka2.30這個版本內建了zookeeper 在kaka目錄下執行命令 bin window...

單機版kafka安裝

export server kafka kafka安裝需要有zookeeper註冊中心 其中 zookeeper的安裝 見centos7安裝偽分布式zookeeper root vm 0 2 centos kafka wget2.解壓 root vm 0 2 centos kafka tar zxv...