Advertisement

Flume集群故障转移配置踩坑

阅读量:

1.需求

​ 体会SinkProcessor,场景就是多个sink同时从一个channel拉取数据!

Agent1: netcatsource----memorychannel-----2AvroSink (hadoop102)

Agent2: ArvoSource----memorychannel-----loggersink (103)

Agent3: ArvoSource----memorychannel-----loggersink (104)

2.所需组件

2.1 Default Sink Processor

在agent中仅存在一个sink的情况下,则应采用Default Sink Processor,并非必须要求用户配置Sink Processor以及相关的sink组设置

2.2 Failover Sink Processor

Failover Sink Processor: A processor designed to manage sink resources with priority handling. This sink processor manages a group of sinks with assigned priorities. It defaults to selecting the si

全部评论 (0)

还没有任何评论哟~