Containers logging to stdout and rsyslog

Registered by Juan Antonio Osorio Robles on 2017-10-06

The proposal is to start logging to stdout/stdout in the container as would be
a standard practice for logging in containers. This would allow the logs to get
picked up by the docker logging driver, and thus we can use "docker logs" to
view the logs of a process as one would usually expect. It would also help us
decouple a bit more the containers from the host, since we wouldn't be mounting
directories from it anymore. This will be done in a pluggable fashion. Furthermore, we will add integration with the Openshift Logging Stack or Viaq, and do so by adding an rsyslog container that forwards and processes the logs.

Blueprint information

Status:
Complete
Approver:
Alex Schultz
Priority:
Medium
Drafter:
Juan Antonio Osorio Robles
Direction:
Approved
Assignee:
Juan Antonio Osorio Robles
Definition:
Approved
Series goal:
Accepted for queens
Implementation:
Implemented
Milestone target:
None
Started by
Alex Schultz on 2017-10-12
Completed by
Alex Schultz on 2018-03-05

Related branches

Sprints

Whiteboard

Queens has been released, Closing this out. Feel free to open bugs/new blueprints if there are still items to fix.

[2017-12-08] Moving out to queens-3 as it's been implemented except for a single patch. If more efforts are needed then this should be moved to Rocky

Addressed by: https://review.openstack.org/510001
    Add blueprint for Logging to stdout and rsyslog

Gerrit topic: https://review.openstack.org/#q,topic:tripleo-logging,n,z

Addressed by: https://review.openstack.org/509486
    Add validation to logging templates

Addressed by: https://review.openstack.org/508517
    Add option for keystone containers to log to stdout/stderr

Addressed by: https://review.openstack.org/509157
    Add option for nova containers to log to stdout/stderr

Addressed by: https://review.openstack.org/509698
    Add log_tag option to container definition

Gerrit topic: https://review.openstack.org/#q,topic:bp/logging-stdout-rsyslog,n,z

Addressed by: https://review.openstack.org/510411
    Add option for Glance API containers to log to stdout/stderr

Addressed by: https://review.openstack.org/510463
    Remove log-dir option from neutron-dhcp execution

Addressed by: https://review.openstack.org/510464
    Add option for Neutron containers to log to stdout/stderr

Addressed by: https://review.openstack.org/510537
    Add option for nova compute container to log to stdout/stderr

Addressed by: https://review.openstack.org/510561
    libvirt: Remove unnecessary binding of /var/log/containers/nova

Addressed by: https://review.openstack.org/510562
    Add option for nova-libvirt container to log to stdout/stderr

Addressed by: https://review.openstack.org/514986
    Remove /dev/log mounting from mysql bundle resource

Addressed by: https://review.openstack.org/515038
    Add option for heat containers to log to stdout/stderr

Addressed by: https://review.openstack.org/515282
    Add rsyslog sidecar image for container image prepare

Addressed by: https://review.openstack.org/515590
    Move keystone init log container to files logging template

Addressed by: https://review.openstack.org/515594
    glance logging: Fix description and use yaml anchor

Addressed by: https://review.openstack.org/516378
    Add option for panko container to log to stdout/stderr

Addressed by: https://review.openstack.org/516564
    Enable keystone db sync to log to stdout

Addressed by: https://review.openstack.org/516730
    Add option for barbican API container to log to stdout/stderr

Gerrit topic: https://review.openstack.org/#q,topic:bug/1730957,n,z

Addressed by: https://review.openstack.org/519256
    Add profile to configure the rsyslog sidecar container

Addressed by: https://review.openstack.org/519361
    Add rsyslog-sidecar resource and configuration

Addressed by: https://review.openstack.org/519362
    Add option for HAProxy (non-HA) container to log to stdout/stderr

Gerrit topic: https://review.openstack.org/#q,topic:bug/1708965,n,z

Addressed by: https://review.openstack.org/521529
    Always load rsyslog-base container

Addressed by: https://review.openstack.org/533060
    Add profile to configure the rsyslog sidecar container

Addressed by: https://review.openstack.org/533061
    Add rsyslog-sidecar resource and configuration

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.