Flume集群故障转移配置踩坑
发布时间
阅读量:
阅读量
1.需求
体会SinkProcessor,场景就是多个sink同时从一个channel拉取数据!
Agent1: netcatsource----memorychannel-----2AvroSink (hadoop102)
Agent2: ArvoSource----memorychannel-----loggersink (103)
Agent3: ArvoSource----memorychannel-----loggersink (104)
2.所需组件
2.1 Default Sink Processor
在agent中仅存在一个sink的情况下,则应采用Default Sink Processor,并非必须要求用户配置Sink Processor以及相关的sink组设置
2.2 Failover Sink Processor
Failover Sink Processor: A processor designed to manage sink resources with priority handling. This sink processor manages a group of sinks with assigned priorities. It defaults to selecting the si
全部评论 (0)
还没有任何评论哟~
