scheduler test suite execution missing in bL mp test build

Bug #1125983 reported by Naresh Kamboju
16
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Linaro Android
Fix Released
High
Axel Fagerstedt

Bug Description

As per the daily dashboard report observation scheduler test suite execution missing in bL mp test build.
Please integrate scheduler testsuite execution on daily bl mp test builds.

LAVA Dashboard:
http://validation.linaro.org/lava-server/dashboard/image-reports/linaro-android-restricted_vexpress-linaro-mp-test

Build:
https://android-build.linaro.org/builds/~linaro-android-restricted/vexpress-linaro-mp-test/#build=133
LAVA_TEST_PLAN="busybox,0xbench,glmark2,skia,v8,mmtest,monkey,monkey_long_run"

Changed in linaro-android:
assignee: nobody → vishal (vishalbhoj)
Changed in linaro-android:
milestone: none → 13.03
Revision history for this message
Naresh Kamboju (naresh-kamboju) wrote :

Hi Vishal,

scheduler test suite execution steps have been modified and build is no more dependent on AOSP.
this is using locally installed cross tool chain and building test binaries and installing these on target by using adb over TCP and running on target and extracting results on to host in a tar ball.

here i have posted the complete execution steps and followed by each test output.
could you integrate this test on to mp-test build and propose the ways to make this testsuite as a default daily build execution on LAVA.

build, install, run. results output:
https://pastebin.linaro.org/1955/

results summary output:
https://pastebin.linaro.org/1956/

vishal (vishalbhoj)
Changed in linaro-android:
assignee: vishal (vishalbhoj) → nobody
assignee: nobody → Axel Fagerstedt (fagerstedt-axel)
milestone: 13.03 → 13.04
vishal (vishalbhoj)
Changed in linaro-android:
importance: Undecided → High
Revision history for this message
Naresh Kamboju (naresh-kamboju) wrote :

currently this work being monitored in
https://blueprints.launchpad.net/linaro-android/+spec/independent-test-suite-builder

Lot of Test suite are being developed in Linaro for Android for the members only access. Currently these test suites are compiled as part of android sources making it difficult to build them independently and distribute them to members. The goal with the test-suite-builder is :
1. Build the tests independent of Android source.
2. Should support build with Makefiles and Android NDK.
3. The artifacts should be available to be downloaded and added as an overlay to system image.
4. The test-suite-builder should be able to patch the system tarball with the artifacts and submit them to LAVA for testing.

Revision history for this message
Axel Fagerstedt (fagerstedt-axel) wrote :

The system for building the testsuite and producing android images is in place (though not fully verified yet).

However a LAVA test wrapper still needs to be written, unless it exists and I have simply not found it?

Changed in linaro-android:
status: New → In Progress
Revision history for this message
Naresh Kamboju (naresh-kamboju) wrote :

[nkambo Apr 25 2013]
sched-testsuite-13.04-release :
https://android-build.linaro.org/builds/~linaro-android-restricted/sched-testsuite-13.04-release/#

Test produced expected results.
Test log:
https://pastebin.linaro.org/view/9f49e940

bL-iks-testsuite-13.04-release
https://android-build.linaro.org/builds/~linaro-android-restricted/bl-iks-testsuite-13.04-release/#

This build has MP kernel image and IKS test suite.
If i have to run IKS test suite, then i have to change the kernel image.
We can not release this to members as it is.

Now, I have changed 13.04 IKS release kernel and tested IKS test suite.
https://pastebin.linaro.org/view/3ee468fd

Revision history for this message
vishal (vishalbhoj) wrote :

We are not releasing the filesystem images to the members but only the overlay binaries.

Revision history for this message
vishal (vishalbhoj) wrote :
Changed in linaro-android:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.