ARM browser benchmarks have been integrated

Registered by Bernhard Rosenkraenzer on 2012-07-02

Why?
As part of our benchmarking push, ARM has asked us to run the benchmarks in http://gitorious.org/methanol on the Android browser to benchmark browser performance. For questions about this git talk to <email address hidden>.

Context?
This is part of the larger ARM benchmarking effort.

What gets produced?
A Monkeyrunner script or set of scripts, callable from the command line, that can run the Android browser and run through each of benchmarks in the Methanol benchmark set. What gets produced should probably be extensible so it can run on other browsers that we may install later. Also, the benchmark data should be extracted into a form that can be further processed. As part of this effort, the script should be called from LAVA for each build.

Where will the work get put?
The host scripts should get put in a git like, MONKEY_RUNNER_URL_1="git://android.git.linaro.org/test/linaro/android/system.git"

Blueprint information

Status:
Complete
Approver:
Zach Pfeffer
Priority:
High
Drafter:
Yongqin Liu
Direction:
Approved
Assignee:
Yongqin Liu
Definition:
Approved
Series goal:
Accepted for future
Implementation:
Implemented
Milestone target:
milestone icon 12.08
Started by
Bernhard Rosenkraenzer on 2012-07-04
Completed by
Yongqin Liu on 2012-08-29

Whiteboard

Notes:
[2012/7/2 pfefferz] Please post notes here.
[2012/7/23 pfefferz] Since JB landed mid-cycle all of Bero's work was put on hold
[2012/08/21 liuyq0307] Because the source files of methanol test are mainly web pages, and androd can't run it rome locally(like sdcard), so delete the first WI that integrate methanol test into build(manifest)
[2012/08/29 liuyq0307] The methanol test is run successfully on official panda-jb-gcc47-tilt-stable-blob: https://android-build.linaro.org/builds/~linaro-android/panda-jb-gcc47-tilt-stable-blob/#build=45
[2012/08/29 liuyq0307] There are some problems to run it on origen and snowball, please see the related bug#1043056

Meta:
Headline: ARM browser benchmarks have been integrated
Acceptance:
1. A mechanism to run the browser benchmarks has been built
2. A method of extracting the data has been created
3. Each build runs the mechanism
4. The data is made available to LAVA and for download
Roadmap id: CARD-134

(?)

Work Items

Work items:
Write a script that will bringup a browser and run through each benchmark: DONE
Collect the data and publish it with each build: DONE
Investigate how to run methanol on Android manually: DONE
Add support for test on Chrome: DONE
Add support to run methanol(DEFAULT) and methanol(CHROME) at one build: DONE

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.