ISO Testcases Review

Registered by Ara Pulido on 2010-05-11

Last cycle we added some "Generic Tests" to the ISO tracker. We also added the concept of optional testcases. With those two features in place, we need to review the list of testcases, and move some of them to Generic or optional

Blueprint information

Status:
Complete
Approver:
Marjo F. Mercado
Priority:
High
Drafter:
None
Direction:
Approved
Assignee:
Ara Pulido
Definition:
Approved
Series goal:
Accepted for maverick
Implementation:
Implemented
Milestone target:
milestone icon maverick-alpha-2
Started by
Marjo F. Mercado on 2010-06-21
Completed by
Robbie Williamson on 2010-06-24

Related branches

Sprints

Whiteboard

== Goal ==
Review testcases to see which ones should be moved to the new 'optional' or 'generic' testcases features

== Current List of Required Testcases ==
http://iso.qa.ubuntu.com/qatracker/subscriptions

=== Only need to be tested once per milestone per arch (not per image) ===
 * alternate manual partitioning
 * alternate expert mode
 * alternate rescue mode

=== Must not be dropped to optional ===
 * wubi
 * live session
 * OEM mode

=== New Test cases ===
 * wubi upgrade (under upgrade tests) after it is fixed
 * VMWare "easy install" (optional) (see bug 548891)
 * broken Internet that doesn't tell you it's broken (packets are dropped, not rejected or returned as unroutable)

=== Option testcases ===
                             title | title
---------------------------------------------------------------+----------------------
 From Desktop Installation - Persistence (CD Source) | Generic tests
 From USB key to USB key (ubiquity) | Generic tests
 From USB key to USB key (usb-creator) | Generic tests
 Live environment - Persistence (CD Self-Source) | Generic tests
 Testing Manual Persistence (ISO Source) | Generic tests
 Non-English Installation Full Network Support | Ubuntu Desktop amd64
 Non-English Installation Full Network Support & CJK Input | Ubuntu Desktop amd64
 Non-English Installation No Network | Ubuntu Desktop amd64
 Non-English Live Session & Installation; Full Network Support | Ubuntu Desktop amd64
 Non-English Live Session & Installation; No Network | Ubuntu Desktop amd64
 Non-English Installation Full Network Support | Ubuntu Desktop i386
 Non-English Installation Full Network Support & CJK Input | Ubuntu Desktop i386
 Non-English Installation No Network | Ubuntu Desktop i386
 Non-English Live Session & Installation; Full Network Support | Ubuntu Desktop i386
 Non-English Live Session & Installation; No Network | Ubuntu Desktop i386
 Install (No Network Connection) | Ubuntu Server amd64
 UEC install (separate components topology) | Ubuntu Server amd64
 UEC install (separate networks topology) | Ubuntu Server amd64
 iSCSI Authenticated Root Installation | Ubuntu Server amd64
 iSCSI Unauthenticated Root Installation | Ubuntu Server amd64
 Install (No Network Connection) | Ubuntu Server i386
 iSCSI Authenticated Root Installation | Ubuntu Server i386
 iSCSI Unauthenticated Root Installation | Ubuntu Server i386

Post ubiquity automated tests back to the ISO tracker [ev]

Work items:
[apulido] Modify ISO tracker test coverage to show when an optional testcase has not been covered: DONE
[apulido] Move alternate manual partitioning to per arch: DONE
[apulido] Move alternate expert mode to per arch: DONE
[apulido] Move alternate rescue mode to per arch: DONE
[apulido] Create wubi upgrade tests: DONE
[apulido] Create VMWare "easy install" as optional (see bug 548891): DONE
[apulido] Create a broken Internet that doesn't tell you it's broken testcase (packets are dropped, not rejected or returned as unroutable): DONE

(?)

Work Items