Openstack & Server QA
[GOAL]
* Package builds
* Integration testing
* Stress Testing
* Upgrade testing
* Topology testing
[RATIONALE]
Ubuntu is the preferred platform for OpenStack - we should do everything possible to keep it that way.
Blueprint information
- Status:
- Not started
- Approver:
- Dave Walker
- Priority:
- High
- Drafter:
- Ubuntu Server
- Direction:
- Approved
- Assignee:
- Chuck Short
- Definition:
- Approved
- Series goal:
- Accepted for saucy
- Implementation:
-
Unknown
- Milestone target:
-
ubuntu-13.10
- Started by
- Completed by
Whiteboard
[USER STORIES]
Andres is an Ubuntu Developer who wants the Ubuntu packaging to be a high quality at all times. He uses the Openstack CI to track possible problems with the Ubuntu packages and fixes them in a timely matter.
Roger is an user who wants to test the latest cutting edge upstream changes. Roger installs the Openstack packages from the Openstack-CI ppa and reports bugs upstream and in Ubuntu.
Sebastian is an Ubuntu Developer who wants to test package upgrades from Ubuntu 12.04 to the latest version. He writes a testcase to perform the upgrade and writes a pipeline to perform the tests at regular intervals.
[ASSUMPTIONS]
Server QA lab will be virtualized using OpenStack supporting regular testing activities.
[RISKS]
Tests get deferred due to suitability to the test environment.
[IN SCOPE]
Package builds
Integration testing
Stress Testing
Upgrade testing
Topology testing
[OUT OF SCOPE]
[USER ACCEPTANCE]
N/A
[RELEASE NOTE/BLOG]
N/A
Work Items
Work items for ubuntu-13.08:
Add support for quantum based security rules to nova and quantum charms: DONE
Add OpenStack + Quantum with L2 tenant separation: DONE
Add DEP-8 tests to openstack packages: DONE
Upstream dependency tracking of pypi: DONE
[gandelman-a] Setup DEP-8 testing for openstack packages on serverstack: DONE
Review reporting of testing results to public jenkins, investigate performance: DONE
Work items for ubuntu-13.09:
Discuss use of HWE kernels with juju/maas teams in terms of support timeframes: TODO
Upgrade testing of packages: POSTPONED
Add tempest stress testing to openstack-ci lab: POSTPONED
Work items for ubuntu-13.10:
Regression testing and upgrade testing of OpenStack charms: TODO
Include heat in pre-commit openstack testing: TODO
Include ceilometer in per-commit openstack testing: TODO
Add reporting of test pipeline (needs IS support): TODO
[gandelman-a] Upgrade testing of OpenStack using charm upgrades: TODO
Include swift in per-commit openstack testing: TODO
Work items:
Add ipv6 support to lab: POSTPONED
Add zeromq support tot lab: POSTPONED
Implement mahem badger -> tempest integration: POSTPONED
Review cloudbox inconjunction with Canonical cert team: POSTPONED
Add smoke testing of the HA configuration: POSTPONED
Dependency tree
* Blueprints in grey have been implemented.
