Support configuration of custom outputs for fluentd

Registered by Mark Goddard

As an operator, I want to be able to configure the fluentd log collector with a custom output, so that I can aggregate logs using a service other than the elasticsearch instance that may be deployed by kolla-ansible.

Kolla-ansible deploys the fluentd log collector on all hosts in order to collect logs from the containerised services and forward them to a log aggregation service. Support exists for forwarding to an elasticsearch instance deployed by kolla-ansible, but it is not possible to forward logs to an unmanaged elasticsearch instance or other log aggregator such as Splunk or Monasca log API[1].

The proposed change would allow an operator to drop fluentd configuration templates into a directory on the control node, e.g. /etc/kolla/config/fluentd/output/, and have these templated and distributed to the /etc/td-agent/output/ directory in the fluentd containers.

[1] https://github.com/taimir/fluentd-monasca

Blueprint information

Status:
Complete
Approver:
None
Priority:
Undefined
Drafter:
Mark Goddard
Direction:
Needs approval
Assignee:
Mark Goddard
Definition:
Approved
Series goal:
Proposed for pike
Implementation:
Implemented
Milestone target:
None
Started by
Mark Goddard
Completed by
Mark Goddard

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/fluentd-custom-outputs,n,z

Addressed by: https://review.openstack.org/483026
    Support configuration of custom fluentd outputs

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.