Linaro Android benchmark suite integration into LAVA

Registered by Jeremy Chang

Integrate 0xbench in LAVA for automation.
All of the results should be arranged for presentation.

Blueprint information

Status:
Complete
Approver:
Alexander Sack
Priority:
High
Drafter:
Jeremy Chang
Direction:
Approved
Assignee:
Jeremy Chang
Definition:
Approved
Series goal:
Accepted for 11.05
Implementation:
Implemented
Milestone target:
milestone icon 11.05
Started by
Alexander Sack
Completed by
Jeremy Chang

Related branches

Sprints

Whiteboard

[asac Mar 19,2011]: needs infrastructure until basic validation blueprint is done; please reflect dependency in blueprint graph (i think the meta blueprint doesnt need to depend on basic validation directly then)
[asac Mar 19,2011]: needs to cover work items that deal with how 0xbench is retrieved/build before adb push; setting to drafting
[asac Mar 19,2011]: this is only non-basic validation blueprint with high to accomate special interest of 0xlab in this topic
[asac Mar 19,2011]: milestone is 11.05, but would prefer to move it to 11.04 once we see that our basic validation integration is working
[jeremychang April 14,2011] abrek is not needed. test result can be transformed to json bundle in lava. The more critical thing is coming out a way to monitor the status of long time running application(native or java), like monkey and benchmarks on the host side, lava.

[jeremychang May 2,2011] Now the way to monitor the status of 0xbench benchmark testing is monitoring the output of the logcat command.

[jeremychang May 24,2011] android 0xbench test is merged to lp:lava and the test results are sent to http://validation.linaro.org/launch-control/dashboard/streams/anonymous/android-panda01-0xbench/

(?)

Work Items

Work items:
[jeremychang] Implement command to run 0xbench test through console in Lava: DONE
[jeremychang] Run benchmark through am command in Lava: DONE
[jeremychang] Come out a way to monitor the status of the benchmark running: DONE
[jeremychang] Transfer the benchmark result to dashboard's json bundle format: DONE
[jeremychang] Submit the result bundle to dashboard for presentation: DONE

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.