[root@server-21 apache-flume-1.6.0-bin]# cat test.properties
# 01-flume-netcat-test
# agent name: a1
# source: netcat
# channel: memory
# sink: logger, local console
# 01 define source,channel,sink name
a1.sources = r1
a1.channels = c1
a1.sinks = k1
# 02 define source
a1.sources.r1.type = netcat
a1.sources.r1.bind = server-21
# ip位址也ok
a1.sources.r1.port = 6666
# 03 define sink
a1.sinks.k1.type = logger
# flume sink將拉取到的資訊，event形式列印到自己被啟動時的終端
# 04 define channel
a1.channels.c1.type = memory
# number of events in memory queue 記憶體佇列中的最大event數值
a1.channels.c1.capacity = 1000
# number of events for 1 commit(每次向memory queuet放入event,取出event的最大值)，所以肯定是比記憶體佇列中的event小
a1.channels.c1.transactioncapacity = 100
# 05 bind source,sink to channel
a1.sources.r1.channels = c1
# 1個source可以有多個channel
a1.sinks.k1.channel = c1
# 1個sink只能從1個channel取資料
Flume 生產配置
1.flume安裝位置 10.96.183.54 home hadoop flume 1.7.0 2.配置文件 aoi.properties aoi.channels c1 aoi.sources r1 aoi.sinks k1 aoi.sources.r1.type spooldir aoi.so...
Flume常用配置
flume常用配置4 taildir.source memory.channel hdfs.sink 以下配置基於版本apache flume 1.8.0 bin 我們假定已經對flume有一定了解，並且對flume 的各個元件有一定了解。我們演示乙個基本的 source 為 taildir源 ch...
flume配置採集日誌
上傳dir hdfs.conf 到flume的conf目錄下 定義三大元件的名稱 ag1.sources source1 ag1.sinks sink1 ag1.channels channel1 配置source元件 ag1.sources.source1.type spooldir ag1.so...