Openstack & Server QA

Registered by Chuck Short on 2013-04-30

[GOAL]
* Package builds
* Integration testing
* Stress Testing
* Upgrade testing
* Topology testing

[RATIONALE]
Ubuntu is the preferred platform for OpenStack - we should do everything possible to keep it that way.

Blueprint information

Status:
Not started
Approver:
Dave Walker
Priority:
High
Drafter:
Ubuntu Server Team
Direction:
Approved
Assignee:
Chuck Short
Definition:
Approved
Series goal:
Accepted for saucy
Implementation:
Unknown
Milestone target:
milestone icon ubuntu-13.10

Related branches

Whiteboard

[USER STORIES]
Andres is an Ubuntu Developer who wants the Ubuntu packaging to be a high quality at all times. He uses the Openstack CI to track possible problems with the Ubuntu packages and fixes them in a timely matter.

Roger is an user who wants to test the latest cutting edge upstream changes. Roger installs the Openstack packages from the Openstack-CI ppa and reports bugs upstream and in Ubuntu.

Sebastian is an Ubuntu Developer who wants to test package upgrades from Ubuntu 12.04 to the latest version. He writes a testcase to perform the upgrade and writes a pipeline to perform the tests at regular intervals.

[ASSUMPTIONS]
Server QA lab will be virtualized using OpenStack supporting regular testing activities.

[RISKS]
Tests get deferred due to suitability to the test environment.

[IN SCOPE]
Package builds
Integration testing
Stress Testing
Upgrade testing
Topology testing

[OUT OF SCOPE]

[USER ACCEPTANCE]
N/A

[RELEASE NOTE/BLOG]
N/A

(?)

Work Items

Work items for ubuntu-13.08:
Add support for quantum based security rules to nova and quantum charms: DONE
Add OpenStack + Quantum with L2 tenant separation: DONE
Add DEP-8 tests to openstack packages: DONE
Upstream dependency tracking of pypi: DONE
[gandelman-a] Setup DEP-8 testing for openstack packages on serverstack: DONE
Review reporting of testing results to public jenkins, investigate performance: DONE

Work items for ubuntu-13.09:
Discuss use of HWE kernels with juju/maas teams in terms of support timeframes: TODO
Upgrade testing of packages: POSTPONED
Add tempest stress testing to openstack-ci lab: POSTPONED

Work items for ubuntu-13.10:
Regression testing and upgrade testing of OpenStack charms: TODO
Include heat in pre-commit openstack testing: TODO
Include ceilometer in per-commit openstack testing: TODO
Add reporting of test pipeline (needs IS support): TODO
[gandelman-a] Upgrade testing of OpenStack using charm upgrades: TODO
Include swift in per-commit openstack testing: TODO

Work items:
Add ipv6 support to lab: POSTPONED
Add zeromq support tot lab: POSTPONED
Implement mahem badger -> tempest integration: POSTPONED
Review cloudbox inconjunction with Canonical cert team: POSTPONED
Add smoke testing of the HA configuration: POSTPONED

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.