Aggregate Browser Benchmark Data

Registered by Zach Pfeffer

Why?
We need to ensure that all the data that gets generated for a given build is aggregated so that we can efficiently analyze the data.

Context?
This is part of the larger ARM benchmarking effort.

What gets produced?
A mechanism that allows the data from the browser benchmarks to be formatted into LAVA "bundles" and a mechanism to send those bundles to a common aggregation point.

Where will the work get put?
The mechanism will stored in android.git.linaro.org if it resides on the target, otherwise it will reside in a bzr project if its run from an external entity.

Blueprint information

Status:
Complete
Approver:
Zach Pfeffer
Priority:
High
Drafter:
Yongqin Liu
Direction:
Needs approval
Assignee:
Yongqin Liu
Definition:
Approved
Series goal:
Accepted for 2012q3
Implementation:
Implemented
Milestone target:
milestone icon 12.09
Started by
Yongqin Liu
Completed by
Yongqin Liu

Whiteboard

Notes:
[2012/09/05 liuyq0307] the result on the official build of panda https://android-build.linaro.org/builds/~linaro-android/panda-jb-gcc47-tilt-stable-blob/#build=50
[2012/09/06 liuyq0307] the result on the official build of origen https://android-build.linaro.org/builds/~linaro-android/origen-jb-gcc47-samsunglt-stable-blob/#build=54
[2012/09/10 liuyq0307] Documented the run instructions on https://wiki.linaro.org/Platform/QA/TestCases/Android
[2012/09/12 liuyq0307] the result on the official build of snowball https://android-build.linaro.org/builds/~linaro-android/snowball-jb-gcc47-igloo-stable-blob/#build=55

Meta:
Headline: The data from the benchmarks that are part of the ARM benchmarking effort has been aggregated with other results per build.
Acceptance: 1 or more of the datasets form the benchmarks have been "bundled" and those bundles are sent to LAVA and aggregated with other automated results.

(?)

Work Items

Work items:
Create a mechanism to extract the results from the unit: DONE
Turn the results into a bundle: DONE
Send that bundle to the aggregation point: DONE
Test on android-build: DONE
Document how to run scripts and where they're located: DONE
Discuss about the aggregation: DONE
List the result url of official build on the Note: DONE

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.