Enable deployment of centralized logging

Registered by Martin Mágr

TripleO should have a possibility to automatically setup and install the centralized logging stack (Elasticsearch, FluentD and Kibana) to service the overcloud.

All components of the centralized logging will be deployed by TripleO using Heat+Puppet. The elasticsearch, kibana and fluentd as a log relay/transformer will be deployed on a stand alone node deployed by the undercloud, with a dedicated purpose for all optools (not only centralized logging, but also performance monitoring and availability monitoring in future).
The Optools node will be deployed as a separate Heat stack to the overcloud stack.

The FluentD as a log collection agent will be deployed as a composable role on the overcloud stack.

Blueprint information

Status:
Complete
Approver:
Steven Hardy
Priority:
High
Drafter:
Martin Mágr
Direction:
Approved
Assignee:
Martin Mágr
Definition:
Approved
Series goal:
Accepted for newton
Implementation:
Implemented
Milestone target:
milestone icon newton-rc1
Started by
Steven Hardy
Completed by
Emilien Macchi

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#/q/topic:ooo/opstools/efk
Gerrit topic: https://review.openstack.org/#/q/topic:ooo/opstools/fluentd

Gerrit topic: https://review.openstack.org/#q,topic:bp/tripleo-opstools-centralized-logging,n,z

Addressed by: https://review.openstack.org/353506
    [WIP] Add fluentd client service

Addressed by: https://review.openstack.org/356691
    [wip] Spec: Centralized logging support

Addressed by: https://review.openstack.org/254788
    Availability monitoring agents support

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.