Collecting OpenStack workload statistics

Registered by Alexander Kislitsky on 2015-01-15

We should collect dynamic statistics of OpenStack usage.
It is required to understand how many VMs are running per day, dynamic of their creation and removing.
Memory, CPUs used per VM.
Changing of number of security groups.
Changing of VMs per node.
Changing of volumes per VM, volumes size.
Changing of number of keystone users, active tenants, VMs per tenant.

Blueprint information

Status:
Complete
Approver:
Nathan Trueblood
Priority:
Essential
Drafter:
Alexander Kislitsky
Direction:
Approved
Assignee:
Artem Roma
Definition:
Drafting
Series goal:
Accepted for 6.1.x
Implementation:
Implemented
Milestone target:
milestone icon 6.1
Started by
Dmitry Pyzhov on 2015-01-15
Completed by
Dmitry Pyzhov on 2015-03-16

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/openstack-workload-statistics,n,z

Addressed by: https://review.openstack.org/150021
    Add DB table for OSWL statistics storing

Addressed by: https://review.openstack.org/144168
    Add collection of info about VMs to OpenStackInfoCollector

Addressed by: https://review.openstack.org/150519
    Add OSWL statictics saving to DB

Addressed by: https://review.openstack.org/150783
    Added scheduler for collectors execution planning

Addressed by: https://review.openstack.org/151223
    Set of utils for OSWL collecting added

Addressed by: https://review.openstack.org/151243
    Add OSWL collector

Gerrit topic: https://review.openstack.org/#q,topic:bp/s,n,z

Addressed by: https://review.openstack.org/151171
    Collecting OSWL

Addressed by: https://review.openstack.org/151702
    Send saved OSWL data into Collector

Addressed by: https://review.openstack.org/152483
    Add oswl_collectord run to supervisord config

Addressed by: https://review.openstack.org/152862
    OpenStack workload VMs info export to CSV

Addressed by: https://review.openstack.org/152946
    Move OSWL collection period to settings

Addressed by: https://review.openstack.org/153319
    Clear resource current data for unavailable clusters

Addressed by: https://review.openstack.org/154919
    Add oswl collector process for flavors

Addressed by: https://review.openstack.org/154926
    Extend oswl utils for flavor collection

Addressed by: https://review.openstack.org/156610
    Volumes info collecting added

Addressed by: https://review.openstack.org/156636
    Seamless CSV report

Gerrit topic: https://review.openstack.org/#q,topic:seamless_csv_report,n,z

Addressed by: https://review.openstack.org/157418
    Collecting OpenStack workloads statistics

Addressed by: https://review.openstack.org/157700
    Get rid of ElasticSearch in export to CSV

Addressed by: https://review.openstack.org/159089
    Filtering by dates handled in CSV exporter

Addressed by: https://review.openstack.org/159093
    Image, volume resources added to CSV export

Addressed by: https://review.openstack.org/159903
    Tenant added to CSV export

Gerrit topic: https://review.openstack.org/#q,topic:bug/1427270,n,z

Addressed by: https://review.openstack.org/160418
    Add parameters for OSWL collector user

Addressed by: https://review.openstack.org/160760
    Use separate user for collecting OSWL data

Addressed by: https://review.openstack.org/160804
    Single report for all CSV reports

Addressed by: https://review.openstack.org/161238
    Data format of workload resource_data changed

Addressed by: https://review.openstack.org/161645
    Data format of workload resource_data changed

Gerrit topic: https://review.openstack.org/#q,topic:bp/blueprint,n,z

Addressed by: https://review.openstack.org/160759
    Add OSWL collector keystone user

Addressed by: https://review.openstack.org/164126
    Keystone_user resource type added to OSWL reports

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.