Drafting testcases for ubuntu flavors

Registered by Nicholas Skaggs on 2012-05-09

Discussing the state of testcases and there use inside of ubuntu flavors. Testcases are generic and ubuntu-centric, causing confusion and poor results when utilizing them for testing flavors

Blueprint information

Status:
Started
Approver:
Jono Bacon
Priority:
Low
Drafter:
None
Direction:
Approved
Assignee:
Nicholas Skaggs
Definition:
Approved
Series goal:
Accepted for quantal
Implementation:
Started
Milestone target:
milestone icon ubuntu-12.10
Started by
Nicholas Skaggs on 2012-06-01

Related branches

Sprints

Whiteboard

SUMMARY:
    Ubuntu plans to move to a testcase management system, but for the moment the testcases are stored in the testcase wiki for iso testing:

    http://testcases.qa.ubuntu.com/

and stored in a checkbox bzr branch for application testing:

http://bazaar.launchpad.net/~nskaggs/checkbox/checkbox-app-testing-qt/files/head:/jobs/

Q: For point releases and next release?
Can talk about it.

Xubuntu: Have a short test and long test on the wiki:
 * https://wiki.ubuntu.com/Xubuntu/Testing/TestingInfo/Short
 * https://wiki.ubuntu.com/Xubuntu/Testing/TestingInfo/Long
Mythbuntu: We don't have test cases beyond ISO testing. Don't plan to add many because we won't likely be able to see a lot of changes upstream if problems are encountered within MythTV itself.
Lubuntu:
 * Follow common test cases for ISO testing
 * Run specific test cases for applications : http://testcases.qa.ubuntu.com/Applications/ ==> LXDE/Lubuntu Based Apps

AGENDA:
    Short-term planning:
        Do we change/edit the testcases on the wiki?
        Plan to evaluate testcases needing to be written
    Long-term planning:
        Will testcase management system support flavors?
            http://summit.ubuntu.com/uds-q/meeting/20462/qa-q-isotracker-testcases/
        How to migrate testcases to new system?
            utilize current testcase wiki, migration will occur as part of migration for ubuntu
        Documentation / features of new system?
        Document where colloborations can occur with ubuntu / other flavors
            plan to discuss as part of meetup

== ACTIONS ==

(?)

Work Items

Work items:
[superm1] Add mythbuntu test cases for install at http://testcases.qa.ubuntu.com/Install and similar specifically for Mythbuntu LTS by 12.04.1 freeze: DONE
[nskaggs] Ensure new flavors testcases are utilized and pointed to by isotracker: DONE