Converting lava-[android-]-tests to use lava-test-shell
With lava_test_shell actions in place and the test case management test definitions mostly defined. We should start converting some current tests from lava-test and lava-android-test over to lava_test_shell.
Many of the tests we run daily for Ubuntu are already mostly in BZR branches under:
https:/
We should work on adding proper YAML test defs to those repos.
Blueprint information
- Status:
- Complete
- Approver:
- Andy Doan
- Priority:
- High
- Drafter:
- None
- Direction:
- Needs approval
- Assignee:
- Senthil Kumaran S
- Definition:
- New
- Series goal:
- None
- Implementation:
- Implemented
- Milestone target:
- 2012.12
- Started by
- Senthil Kumaran S
- Completed by
- Senthil Kumaran S
Related branches
Sprints
Whiteboard
[stylesen, 2012-12-19]
All the android related test definition conversions could be done only after fixing bug#1092032, hence pushing it to next cycle.
[stylesen, 2012-12-17]
UPDATE2: Added YAML test definition for toolchain version check in OE.
UPDATE1: Added YAML test definition for kernel version check in OE.
[stylesen, 2012-12-14]
UPDATE2: Merged the changes for daily prebuilt images script, which is now capable of using lava-test-shell.
UPDATE1: Bootchart test is converted and pushed to the new git test definition git repository.
[stylesen, 2012-12-13]
UPDATE1: New YAML format tests are comiitted to http://
[styesen, 2012-12-11] Should add more WI to OE test definition work.
UPDATE1: Created OE test definition bzr repository where all the test definitions will be added for OE - lp:~stylesen/lava-dispatcher/lava-test-shell-conversions-part1-oe
[stylesen, 2012-12-10]
UPDATE3: Power Management test is converted and pushed. Ran this test in pandaboard and confirmed.
UPDATE2: e2audio test is converted and pushed. Ran this test in pandaboard and confirmed.
UPDATE1: Leb Basic Graphics test is converted and pushed. Ran this test in pandaboard and confirmed.
[stylesen, 2012-12-07]
UPDATE2: Wifi Enablement test is converted and pushed. Ran this test in pandaboard and confirmed.
UPDATE1: Bluetooth Enablement test is converted and pushed. Ran this test in pandaboard and confirmed.
Regarding 'liuyq0307's query - If required additional bits will be added in order to support monkeyrunner. I haven't got to that point yet, will explore and discuss when I touch that WI :)
[liuyq0307, 2012-12-07] the monkeyrunner should be run from outside with the adb connection, does the related WI means we will do something to make lava-test-shell support it?
[doanac, 2012-12-07] liuyq0307 - I'm not implying to run monkeyrunner scripts in lava-test-shell, I'm saying I think we can do the equivalent of those .py scripts as shell scripts that run directly on the target. (an email was sent on this topic as well).
[stylesen, 2012-12-06]
UPDATE2: gatortests are converted and pushed. Ran this test in pandaboard and confirmed. This uses "lava-test-case" :)
UPDATE1: Perf tests are converted and pushed. Ran this test in pandaboard and confirmed.
[stylesen, 2012-12-05]
UPDATE2: Device tree tests are converted and pushed in the below location. Ran this test in pandaboard and confirmed.
UPDATE1: Started with converting test cases. It will be available in lp:~stylesen/lava-dispatcher/lava-test-shell-conversions-part1
[doanac, 2012-11-21] We may want to change the work items below. The first thing we
may want to help with is setting up a test definition/repo for: https:/
Meta:
Headline: Conversion to lava-test-shell started
Acceptance: All test showing up under our image-status reports now have an equivalent lava-test-shell version.
Roadmap id: CARD-200
Work Items
Work items:
convert daily-pre-built test gatortests: DONE
convert daily-pre-built test pwrmgmt: DONE
convert daily-pre-built test perf: DONE
convert daily-pre-built test device-tree: DONE
convert daily-pre-built test e2eaudiotest: DONE
convert daily-pre-built test bluetooth-
convert daily-pre-built test wifi-enablemement: DONE
convert daily-pre-built test leb-basic-graphics: DONE
convert daily-pre-built test bootchart: DONE
update daily-pre-built script to use lava-test-shell instead of lava-test: DONE
setting up a test definition/repo for OpenEmbedded: DONE
testdef for Kernel Version in OE: DONE
testdef for Toolchain Version in OE: DONE
testdef for Busybox in OE: DONE
testdef for Ethernet in OE: DONE
testdef for MySQL in LAMP OE Image: DONE
convert android test: v8: POSTPONED
convert android test: busybox: DONE
convert android test: glmark2: POSTPONED
convert an android monkeyrunner test: POSTPONED
Dependency tree
* Blueprints in grey have been implemented.