Scenario testing for kolla-ansible

Registered by Gema Gomez

This blueprint will track the work related to adding scenario test jobs to the gates. These jobs will run a subset of tempest tests on a set of representative deployments that will allow us to do integration testing of the containers.

Blueprint information

Status:
Started
Approver:
kolla-drivers
Priority:
Medium
Drafter:
Gema Gomez
Direction:
Approved
Assignee:
kolla-drivers
Definition:
Approved
Series goal:
Accepted for ussuri
Implementation:
Started
Milestone target:
None
Started by
Mark Goddard

Related branches

Sprints

Whiteboard

Discussed at Stein PTG: https://etherpad.openstack.org/p/kolla-stein-ptg-scenario-testing

Some scenarios have been implemented during the Stein cycle:

* cinder LVM
* Zun
* NFV

No doubt we need more.

Gerrit topic: https://review.opendev.org/#/q/topic:kolla-deployment-scenario-testing

Addressed by: https://review.opendev.org/696364
    CI: Test Swift

Addressed by: https://review.opendev.org/696127
    CI: Test Qinling

Addressed by: https://review.opendev.org/697136
    CI: Test Senlin

Addressed by: https://review.opendev.org/700232
    CI: Test Swift

Addressed by: https://review.opendev.org/700268
    DNM: CI: Test Swift upgrade

(?)

Work Items

Work items:
- Define the scenarios / architectures that will be used for this testing: TODO
- Put together the config necessary to deploy the reference scenarios chosen: TODO
- Decide whether to run tempest directly or use a wrapper such as refstack-client for running the tests: TODO
- Put together the jobs that run the tests: TODO

This blueprint contains Public information 
Everyone can see this information.