Testing

Registered by Loïc Minier on 2010-09-28

Run test suite periodically, fixing regressions and adding coverage.
Investigate use of abrek or checkbox to automate testing of keyboards, mice, and other input devices.
Investigate use of openPosix, gmpbench, and gtkperf to automate testing.

Blueprint information

Status:
Complete
Approver:
None
Priority:
High
Drafter:
None
Direction:
Needs approval
Assignee:
None
Definition:
Obsolete
Series goal:
Accepted for 11.05
Implementation:
Not started
Milestone target:
None
Completed by
Mounir Bsaibes on 2012-05-24

Related branches

Sprints

Whiteboard

Goals:

1) Identify and define missing tests
2) Define some level of automation

Requirements:

kexec test - implement a multi-call kexec test to validate kexec doesn't have memory corruption problems: TODO
NEON test methods - develop simple NEON enabled tests to validate compiler generated correct NEON enabled code: TODO
Thumb/ARM tests - develop a find/simple test to validate Thumb/ARM binary: TODO
Security test investigation: TODO
Security test implementation: TODO
DDR Memory tests: TODO
Use test cases available in the kernel source tree like dma_test.c, mmc_test.c, suspend_test.c, usb_test.c, rtc_test.c etc
These test cases may be adjusted a little bit to run automatically in LTP, add consistent return values for pass and fail.
Ask vendors for LTP test suite: TODO
Determine suitability of all these tests for inclusion (and include) into LTP: TODO

Investigate the checkbox test system as a method to implement manual/automated validation on specific platform: TODO
Determine re-use of already developed tests within Canonical's QA: TODO
USB tests: TODO
Keyboard: TODO
Mouse: TODO
Audio: TODO
Display: TODO

Identify steps from current tests that can be automated: TODO
Integrate tests into an automated system (checkbox ?): TODO
Integrate automated tests into a nightly run or a build completion mechanism: TODO
Output results from automated tests into dashboard: TODO

Identify platforms that can be consolidated to a common test location: TODO
Implement a reset mechanism for each identified platform (power cycle or openocd): TODO
Investigate implementation of testing normally manual tests (framebuffer, USB, etc.): TODO
Start consolidation of platforms to common test location: TODO

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.