Add basic tests for Ceilometer

Registered by Feilong Wang

Now Ceilometer is the important metering/monitoring projects of OpenStack. So it's necessary to include the basic tests into Tempest to make sure it works fine.

1. Successful get resources/metrics by REST API

2. Basic meta data query

3. CLI basic functionalities

Blueprint information

Status:
Complete
Approver:
Matthew Treinish
Priority:
Medium
Drafter:
Feilong Wang
Direction:
Approved
Assignee:
Yassine
Definition:
Obsolete
Series goal:
Accepted for juno
Implementation:
Good progress
Milestone target:
milestone icon juno-rc
Started by
Giulio Fidente
Completed by
Matthew Treinish

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/add-basic-ceilometer-tests,n,z
------------------------------------------------------------------------------------

Merged:

Addressed by: https://review.openstack.org/49700
    Adds initial ceilometerclient testing code

Addressed by: https://review.openstack.org/64304/
    Add base class for Telemetry tests

Addressed by: https://review.openstack.org/64299/
    Add config for Telemetry

Addressed by: https://review.openstack.org/82491
    Adds more testcases to test_telemetry_alarming_api

--------------------------------------

Review in Progress:

Addressed by: https://review.openstack.org/55276
    Create telemetry client

Addressed by: https://review.openstack.org/#/c/46744/
    Add tests for Ceilometer object storage metering

Addressed by: https://review.openstack.org/43481/
    Add client and tests for Ceilometer compute metering

Addressed by: https://review.openstack.org/67164/
    Added cinder and neutron notifications tests for ceilometer

Addressed by: https://review.openstack.org/64136/
    Added compute notifications tests for ceilometer

Addressed by: https://review.openstack.org/92557
    Adds "alarm-history" to test_telemetry_alarming_api

--------------------------------------

Abandoned:

Addressed by: https://review.openstack.org/39237
    Adds client for Ceilometer alarms

Addressed by: https://review.openstack.org/46745
    Add client and tests for Ceilometer object storage metering

------------------------------------------------------------------------------------

Gerrit topic: https://review.openstack.org/#q,topic:basedon6and14,n,z

------------------------------------------------------------------------------------

Review in Progress:

Addressed by: https://review.openstack.org/58470
    Add vcpu & disk testcases

--------------------------------------

Abandoned:

Addressed by: https://review.openstack.org/59957
    add telemetry test cases - compute

------------------------------------------------------------------------------------

Gerrit topic: https://review.openstack.org/#q,topic:add_volume_meter_test,n,z
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------

Pending Devstack/Gate Issues/Reviews to have ceilometer working in gate without errors in ceilometer log files:

https://review.openstack.org/#/c/53291/ Allow users to configure the CM pipeline interval
https://review.openstack.org/#/c/53321/ make record_metering_data concurrency safe - critical for gating
https://review.openstack.org/#/c/53290/ cm-cpu-agent only support libvirt driver Merged
https://bugs.launchpad.net/ceilometer/+bug/1243292 Network notification plugin is broken

Gerrit topic: https://review.openstack.org/#q,topic:master,n,z

Addressed by: https://review.openstack.org/70956
    Add CRUD tests for telemetry alarming

Addressed by: https://review.openstack.org/70998
    Add swift notifications tests for ceilometer

Addressed by: https://review.openstack.org/71259
    Add glance notifications tests for ceilometer

Addressed by: https://review.openstack.org/79942
    Adds more verification in list alarms

Addressed by: https://review.openstack.org/80965
    Add compute pollsters tests for ceilometer

Gerrit topic: https://review.openstack.org/#q,topic:bp/add-ceilometer-scenario-tests,n,z

Addressed by: https://review.openstack.org/97252
    Add spec for the bp:add-basic-ceilometer-tests

Gerrit topic: https://review.openstack.org/#q,topic:ceilometer-specs,n,z

(?)

Work Items

Work items:
Adds initial ceilometerclient testing code: DONE
[yassine] Add base class for Telemetry tests: DONE
[yassine] Add config for Telemetry: DONE
[vrovachev] Create telemetry client for tempest: INPROGRESS
Create compute notifications tests: TODO
[vrovachev] Create cinder notifications tests: INPROGRESS
[vrovachev] Create neutron notifications tests: INPROGRESS
[yassine] Create object storage notifications tests: INPROGRESS
[vrovachev] Create all pollsters tests: TODO
Create all alarms tests: TODO

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.