Converting lava-[android-]-tests to use lava-test-shell

Registered by Andy Doan on 2012-11-12

With lava_test_shell actions in place and the test case management test definitions mostly defined. We should start converting some current tests from lava-test and lava-android-test over to lava_test_shell.

Many of the tests we run daily for Ubuntu are already mostly in BZR branches under:

 https://code.launchpad.net/~linaro-foundations

We should work on adding proper YAML test defs to those repos.

Blueprint information

Status:
Complete
Approver:
Andy Doan
Priority:
High
Drafter:
None
Direction:
Needs approval
Assignee:
Senthil Kumaran S
Definition:
New
Series goal:
None
Implementation:
Implemented
Milestone target:
milestone icon 2012.12
Started by
Senthil Kumaran S on 2012-12-06
Completed by
Senthil Kumaran S on 2012-12-19

Whiteboard

[stylesen, 2012-12-19]

All the android related test definition conversions could be done only after fixing bug#1092032, hence pushing it to next cycle.

[stylesen, 2012-12-17]

UPDATE2: Added YAML test definition for toolchain version check in OE.

UPDATE1: Added YAML test definition for kernel version check in OE.

[stylesen, 2012-12-14]

UPDATE2: Merged the changes for daily prebuilt images script, which is now capable of using lava-test-shell.

UPDATE1: Bootchart test is converted and pushed to the new git test definition git repository.

[stylesen, 2012-12-13]

UPDATE1: New YAML format tests are comiitted to http://git.linaro.org/gitweb?p=ubuntu/test-definitions.git by fabo which is its home in future.

[styesen, 2012-12-11] Should add more WI to OE test definition work.

UPDATE1: Created OE test definition bzr repository where all the test definitions will be added for OE - lp:~stylesen/lava-dispatcher/lava-test-shell-conversions-part1-oe

[stylesen, 2012-12-10]

UPDATE3: Power Management test is converted and pushed. Ran this test in pandaboard and confirmed.

UPDATE2: e2audio test is converted and pushed. Ran this test in pandaboard and confirmed.

UPDATE1: Leb Basic Graphics test is converted and pushed. Ran this test in pandaboard and confirmed.

[stylesen, 2012-12-07]

UPDATE2: Wifi Enablement test is converted and pushed. Ran this test in pandaboard and confirmed.

UPDATE1: Bluetooth Enablement test is converted and pushed. Ran this test in pandaboard and confirmed.

Regarding 'liuyq0307's query - If required additional bits will be added in order to support monkeyrunner. I haven't got to that point yet, will explore and discuss when I touch that WI :)

[liuyq0307, 2012-12-07] the monkeyrunner should be run from outside with the adb connection, does the related WI means we will do something to make lava-test-shell support it?
[doanac, 2012-12-07] liuyq0307 - I'm not implying to run monkeyrunner scripts in lava-test-shell, I'm saying I think we can do the equivalent of those .py scripts as shell scripts that run directly on the target. (an email was sent on this topic as well).

[stylesen, 2012-12-06]

UPDATE2: gatortests are converted and pushed. Ran this test in pandaboard and confirmed. This uses "lava-test-case" :)

UPDATE1: Perf tests are converted and pushed. Ran this test in pandaboard and confirmed.

[stylesen, 2012-12-05]

UPDATE2: Device tree tests are converted and pushed in the below location. Ran this test in pandaboard and confirmed.

UPDATE1: Started with converting test cases. It will be available in lp:~stylesen/lava-dispatcher/lava-test-shell-conversions-part1

[doanac, 2012-11-21] We may want to change the work items below. The first thing we
may want to help with is setting up a test definition/repo for: https://wiki.linaro.org/Platform/QA/TestCases/OpenEmbedded

Meta:
Headline: Conversion to lava-test-shell started
Acceptance: All test showing up under our image-status reports now have an equivalent lava-test-shell version.
Roadmap id: CARD-200

(?)

Work Items

Work items:
convert daily-pre-built test gatortests: DONE
convert daily-pre-built test pwrmgmt: DONE
convert daily-pre-built test perf: DONE
convert daily-pre-built test device-tree: DONE
convert daily-pre-built test e2eaudiotest: DONE
convert daily-pre-built test bluetooth-enablemement: DONE
convert daily-pre-built test wifi-enablemement: DONE
convert daily-pre-built test leb-basic-graphics: DONE
convert daily-pre-built test bootchart: DONE
update daily-pre-built script to use lava-test-shell instead of lava-test: DONE
setting up a test definition/repo for OpenEmbedded: DONE
testdef for Kernel Version in OE: DONE
testdef for Toolchain Version in OE: DONE
testdef for Busybox in OE: DONE
testdef for Ethernet in OE: DONE
testdef for MySQL in LAMP OE Image: DONE
convert android test: v8: POSTPONED
convert android test: busybox: DONE
convert android test: glmark2: POSTPONED
convert an android monkeyrunner test: POSTPONED

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.