Versioning for ostf tests

Registered by Dima Shulyak on 2014-11-28

During development of new releases we may introduce new sets of tests that simply
wont work on older environments. Since we support master node upgrade, we need to exclude those tests
from test runs.

It can be done with:

1. Flexible versions comparators , e.g 2014.*-6.* > *-6.*
It will require modifying docstring and designing such comparator

2. Distributing tests for each release, e.g tests for 2014-2-6.0 will be in separate directory,
and when ostf will be invoked to run tests for specific release, it will check version of cluster release, and discover tests
of correct version.

Affected patches:

  neutron tests - Change-Id: I8cd108156c95b119b11e84f772280846b7953d6b
  ceilometer tests - Change-Id: I4f488166223ca6bbd294815e6bff7215ad6009ba

Blueprint information

Status:
Complete
Approver:
Dmitry Pyzhov
Priority:
High
Drafter:
Dima Shulyak
Direction:
Approved
Assignee:
Artem Roma
Definition:
New
Series goal:
Accepted for 6.1.x
Implementation:
Implemented
Milestone target:
milestone icon 6.1
Started by
Artem Roma on 2015-03-03
Completed by
Artem Roma on 2015-03-03

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/ostf-tests-versioning,n,z

Addressed by: https://review.openstack.org/147200
    Add 2014.2-6.1 release tags to versioned tests

Addressed by: https://review.openstack.org/150011
    Add versioning for fuel_health tests

Addressed by: https://review.openstack.org/154979
    Revert "Add versioning for fuel_health tests"

Addressed by: https://review.openstack.org/155331
    Version for tests added

Addressed by: https://review.openstack.org/155336
    Add release version to fuel_health tests

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.