Daily smoke testing to be added

Registered by Gema Gomez on 2012-10-18

Discuss existing smoke testing and agree on what needs to be added as a matter of priority during the cycle.

Blueprint information

Status:
Complete
Approver:
Pete Graner
Priority:
Essential
Drafter:
Gema Gomez
Direction:
Approved
Assignee:
Canonical Platform QA Team
Definition:
Approved
Series goal:
None
Implementation:
Implemented
Milestone target:
None
Started by
Gema Gomez on 2012-10-18
Completed by
Gema Gomez on 2013-11-11

Related branches

Sprints

Whiteboard

Have a look at what daily testing we are doing and agree on areas that need to be covered during R.

(?)

Work Items

Work items for ubuntu-13.04-month-1:
[psivaa] Setup desktop upgrade tests for raring: DONE
[psivaa] Setup server upgrade tests for raring: DONE

Work items for ubuntu-13.04-month-2:
[psivaa] Add a chinese preseeded install to smoke testing (blocked on https://bugs.launchpad.net/ubuntu-cdimage/+bug/1085918): BLOCKED
[gema] Get a list of seeded applications and prioritize the test cases (To be done next cycle, when we actually get to add new test cases): POSTPONED

Work items for ubuntu-13.04-month-3:
[javier.collado] Provide provisioning method for VM snapshots: POSTPONED
[psivaa] Add a preseeded install in a language other than English: DONE

Work items for ubuntu-13.04-month-5:
[gema] Look into running some coreutils autopackage tests with utah for smoke testing (autopkgtest: https://bugs.launchpad.net/ubuntu/+source/coreutils/+bug/1073445): POSTPONED
[doanac] Setup jenkins job to run the autopilot tests from lp:ubuntu-autopilot-tests: POSTPONED
[javier.collado] Add UTAH Raring Core armhf default job to smoke testing(https://jenkins.qa.ubuntu.com/view/Quantal/view/ISO%20Testing%20Dashboard/job/quantal-core-armhf_default/): POSTPONED
[javier.collado] Add UTAH Raring Core amd64 default job to smoke testing (https://jenkins.qa.ubuntu.com/view/Quantal/view/ISO%20Testing%20Dashboard/job/quantal-core-amd64_default/): POSTPONED
[javier.collado] Add UTAH Raring Core i386 default job to smoke testing (https://jenkins.qa.ubuntu.com/view/Quantal/view/ISO%20Testing%20Dashboard/job/quantal-core-i386_default/) : POSTPONED
[javier.collado] Update jenkins job setup script to generate the same configuration xml as in the jobs we currently have (to avoid having to adjust them manually when the script is used): DONE
[nskaggs] Make sure that after the changes, the manual testing in the tracker still makes sense: BLOCKED
[nskaggs] To make sure that the tests can be run locally for the community to use: BLOCKED
[fginther] Investigate a set of unity desktop tests to use for smoke testing (run in < 1 minute): POSTPONED
[javier.collado] Add UTAH Raring desktop amd64 min config job to jenkins (https://jenkins.qa.ubuntu.com/job/quantal-desktop-amd64_min-config/): DONE
[javier.collado] Add UTAH Raring desktop i386 min config job to jenkins (https://jenkins.qa.ubuntu.com/job/quantal-desktop-i386_min-config/): DONE

Work items for ubuntu-13.04-month-6:
[javier.collado] Add UTAH Raring server panda jobs, server panda default, server panda dns-server, server panda ssh (see https://jenkins.qa.ubuntu.com/view/Quantal/view/ISO%20Testing%20Dashboard/): POSTPONED
[pwlars] Add tests for apt-get to smoke testing: POSTPONED
[pwlars] Add smoke test runs on nexus7 ubuntu-desktop: DONE

Work items for ubuntu-13.04:
[pwlars] Add a test scenario to the automated testing in Jenkins to address full updated installs with Ubiquity (problems with third party and software update selected), test installers with updates on so that we can catch regressions for alpha3, beta1 and beta2 images (to be added after UTAH migration is complete): POSTPONED
[psivaa] Make sure that some ubiquity tests end up in smoke testing: POSTPONED
[pwlars] Move upgrade testing to UTAH: POSTPONED