Server QA workflow

Registered by Thierry Carrez on 2010-10-13

How to improve server QA in general. This will cover efforts such as daily triage, SRU tracking, ISO testing, apport hooks.

Blueprint information

Status:
Started
Approver:
Marjo F. Mercado
Priority:
Medium
Drafter:
C de-Avillez
Direction:
Approved
Assignee:
C de-Avillez
Definition:
Approved
Series goal:
Accepted for natty
Implementation:
Slow progress
Milestone target:
milestone icon ubuntu-11.04
Started by
Marjo F. Mercado on 2010-11-18

Related branches

Sprints

Whiteboard

# QA workflow redux
# Foundations bug triage overlap? -- apt, mdadm, dpkg, all critical to servers and needing more bug attention
# SRU tracking
# Daily triage
# ISO testcases review
# Apport hooks ? (should be reviewed and worked on on opportunity)
# Bug reporting guidelines and acknowledgements
# [smoser] QA ownership of Stable Release UEC Image Refresh
(frankly, I do not think QA should do image refreshes -- hggdh2)
# [smoser] QA ownership / running of EC2 test suite
# More Daily VCS ?

Work Items for natty-alpha-1:
[hggdh2]: propose temporary Hudson server: DONE
[hggdh2] Propose server testing plan: DONE
[hggdh2] Hudson temporary deployment on AWS (a small instance): DONE
[hggdh2] send a note to all QA pointing to the Hudson deployment, and ask for machines to be slaves: DONE
[zul] SRU tracking -- instruction writeup: POSTPONED
[zul] Daily VCS -- instruction writeup: POSTPONED
[hggdh2] SRU tracking -- verify what can be passed over to QA (zul, pedro_, hggdh2): POSTPONED
[zul] Daily VCS -- discuss with server team what, if any, QA can take over: POSTPONED
[hggdh2] Run EC2 test suite on natty-alpha-1 (ran EC2 tests on Maverick UEC): DONE
[hggdh2] Run ISO tests on natty-alpha1: DONE

Work Items for natty-alpha-2:
[hggdh2] QA take over of the EC2 test suite from smoser : DONE
zul] SRU tracking -- instruction writeup: DONE
[zul] Daily VCS -- instruction writeup: DONE
[hggdh2] SRU tracking -- verify what can be passed over to QA (zull, pedro_, hggdh2): DONE
[zul] Daily VCS -- discuss with server team what, if any, QA can take over: DONE
[hggdh2] ISO testcases review -- should be done together with the Natty automated server tests blueprint? (bug 712145
): DONE
[hggdh2] Run EC2 test suite on natty-alpha-2 (smoser and andre ran it, alpha2 X upgrade caused X to fail on my laptop): DONE
[hggdh2] Run ISO tests on natty-alpha2: DONE

Work Items for natty-alpha-3:
[hggdh2] Run EC2 test suite on natty-alpha-3 (performed by smoser): DONE
[hggdh2] Run ISO tests on natty-alpha3: DONE

Work Items for ubuntu-11.04-beta-1:
[hggdh2] Run EC2 test suite on ubuntu-11.04-beta-1: TODO
[hggdh2] Run ISO tests on ubuntu-11.04-beta-1: TODO

Work Items for ubuntu-11.04:
[hggdh2] Run EC2 test suite on ubuntu-11.04-RC: TODO
[hggdh2] Run ISO tests on ubuntu-11.04-RC: TODO
[hggdh2] Run EC2 test suite on ubuntu-11.04 final: TODO
[hggdh2] Run ISO tests on ubuntu-11.04 final: TODO

(?)

Work Items