Add monitoring solution

Registered by Alicja Kwasniewska

To administrate Kolla deployment better, it would be good to provide a solution which will allow for collecting, processing and storing not only system data but also container metrics and OpenStack metrics.

One suggested solution is to use snap (https://github.com/intelsdi-x/snap), which provides a wide range of plugins for collecting, decorating and exposing telemetry data. The plugin catalog is available here: https://github.com/intelsdi-x/snap/blob/master/docs/PLUGIN_CATALOG.md
Plugins that could be used in Kolla include for example Collectors: CPU, Docker, Nova, Ceph, Cinder, Glance, HAproxy, Keystone, Neutron and much more.
Plugin based architecture allows for flexible and modular design that could be customized and further modified by adding new plugins and tasks. It is also possible to create new plugins and load them into snap.
There are also plugins for collecting logs, so theoretically snap could in future replace also logging solution. As a result we will have one framework for both needs (monitoring and logging).
Snap also supports a tribe mode, which allows nodes to work in groups. Thanks to this solution administration of a snap is really easy, because administrators can control all Snap nodes in a tribe agreement by messaging just one of them.

The blueprint implementation will include:
- container with snap
- container with database which will store metrics
- container with a visualization tool to view metrics
- Ansible playbooks to deploy the whole monitoring stack

Blueprint information

Status:
Complete
Approver:
None
Priority:
Undefined
Drafter:
Alicja Kwasniewska
Direction:
Needs approval
Assignee:
Alicja Kwasniewska
Definition:
New
Series goal:
None
Implementation:
Implemented
Milestone target:
None
Started by
Alicja Kwasniewska
Completed by
Mark Goddard

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/monitoring,n,z

Addressed by: https://review.openstack.org/446164
    Added snap-telemetry container

Addressed by: https://review.openstack.org/446165
    Added playbooks for snap deployment

Addressed by: https://review.openstack.org/446624
    Install InfluxDB Plugin in Grafana

Addressed by: https://review.openstack.org/446689
    Add InfluxDB as a data source in Grafana

Gerrit topic: https://review.openstack.org/#q,topic:bug/1673512,n,z

We now have prometheus, monasca and telemetry, so marking closed.

(?)

Work Items

Work items:
Install InfluxDB plugin in Grafana and load the plugin to be used as a Data Source: INPROGRESS

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.