QA Efforts for UEC - Natty

Registered by C de-Avillez

This is a continuation/expansion of our efforts for QA on UEC. We intend to focus on details now:
* Installation
* Upgrades
* Compatibility with EC2
* Drill down on failures, and estimate failure rates

Blueprint information

Status:
Complete
Approver:
Robbie Williamson
Priority:
Medium
Drafter:
C de-Avillez
Direction:
Approved
Assignee:
C de-Avillez
Definition:
Approved
Series goal:
Accepted for natty
Implementation:
Implemented
Milestone target:
milestone icon ubuntu-11.04
Started by
Marjo F. Mercado
Completed by
Robbie Williamson

Related branches

Sprints

Whiteboard

Notes:

 * we will need to test both Eucalyptus and openstack, but we do not have enough resources
 * no long-term testing currently run -- at most we run during a full weekend, but with contrived tests; we do not have a "view" for long-term common (whatever we define by 'common') usage
 * exchange tests/procedures with Eucalyptus (needs better automation on the UEC tests)
 * Dustin to give Carlos his euca2ools test script

Blocker:
Work Items for natty-alpha-1:
[hggdh2] QA bug 675372, pass 1: DONE
[hggdh2] QA bug 675372, pass2: DONE
[hggdh2] Regression test for OpenJDK update on Maverick: DONE
[hggdh2] Send request for additional test rig: DONE
[hggdh2] Automate UEC tests install using current ISO image: DONE
[hggdh2] Run UEC tests on natty-alpha1 (bug 684304): DONE

Work Items for natty-alpha-2:
[hggdh2] QA bug 675372, pass3: DONE
[hggdh2] Take over euca2ools test from kirkland: DONE
[hggdh2] Integrate euca2ools tests: DONE
[hggdh2] Consolidate UEC test results in email(?) for QA dashboard: POSTPONED
[hggdh2] Automate user creation on the UEC tests (depends on euca-add-user/other): POSTPONED
[hggdh2] find out about a long-term test rig (none available): DONE
[hggdh2] prepare tests for openstack (initial implementation by zul): DONE
[hggdh2] Run UEC tests on natty-alpha2 (bug 711590, bug 711587): DONE

Work Items for natty-alpha-3:
[hggdh2] Consolidate UEC test results in email(?) for QA dashboard (no working Euca): POSTPONED
[hggdh2] Automate user creation on the UEC tests (depends on euca-add-user/other, no working Euca): POSTPONED
[hggdh2] Automate UEC tests setup (image creation, configuration setup) (no working Euca): POSTPONED
[hggdh2] Update README instructions for installing/running the UEC tests (no working Euca): POSTPONED
[hggdh2] Run UEC tests on natty-alpha3: DONE

Work Items for ubuntu-11.04-beta-1:
[hggdh2] Consolidate UEC test results in email(?) for QA dashboard (Oneiric): POSTPONED
[hggdh2] Automate user creation on the UEC tests (Oneiric, depends on euca-add-user/other, bug 731702): POSTPONED
[hggdh2] Automate UEC tests setup (image creation, configuration setup): DONE
[hggdh2] Update README instructions for installing/running the UEC tests: DONE
[hggdh2] Run UEC tests on ubuntu-11.04-beta-1: DONE

Work Items for ubuntu-11.04:
[hggdh2] Run UEC tests on 11.04: DONE

(?)

Work Items