Integrate Android Benchmarks Run by ARM

Registered by Zach Pfeffer on 2012-05-31

ARM has verified the following Android benchmark applications:

* Linpack
* Quadrant
* Geekbench 2 ( from google play)
* Geekbench 2-202007 ( benchmark team)
* Vellamo
* Andebench
* Antutu Benchmark-59
* Caffeine mark
* Nbench (from google play)
* GLBenchmark 2.1.4-10

Rest are browser based benchmarks (e.g. bbench, browsermark etc). We will integrate these into the build and test them. If DS-5 is available, we'll use DS-5 to profile.

[Ashwin]:
Make sure that background load is less than 0.5%. You can confirm this by profiling idle state after booting up the board.
For profiling you should disable CPU throttling using the following command. This will ensure that CPU is clocked at 1GHz (for Snowball) in running mode. With fixed CPU clock, analysis becomes easy.
echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor

Blueprint information

Status:
Complete
Approver:
Zach Pfeffer
Priority:
High
Drafter:
vishal
Direction:
Approved
Assignee:
vishal
Definition:
Approved
Series goal:
Accepted for 2012q2
Implementation:
Implemented
Milestone target:
milestone icon 12.06
Started by
Amit Pundir on 2012-06-06
Completed by
Zach Pfeffer on 2012-06-25

Related branches

Sprints

Whiteboard

Notes:
[2012/5/31 pfefferz]: Put notes here.
[2012/6/7 pundiramit]: Downloaded all the apps except Geekbench, and Caffeine. Couldn't locate/download them.
[2012/6/12 vishalbhoj]: To take care of variance we are doing this:
1.Network activity disabled (like wifi and ethernet) .
2.Set cpufreq governor to performance to stay at max possible frequency.
3.Kill background processes with activity manager (am kill-all).
4.Run Benchmarking application in automated fashion using monkeyrunner.
[2012/6/25 pfefferz] Splitting remaining work into: https://blueprints.launchpad.net/linaro-android/+spec/automate-benchmark-apps (12.07) and
https://blueprints.launchpad.net/linaro-android/+spec/integrate-arms-benchmark-to-lava (12.07)

Meta:
Headline: The set of Android benchmarks that were run by ARM have been integrated into LAVA
Acceptance: The set of Android benchmarks that were run by ARM have been integrated into LAVA

(?)

Work Items

Work items:
Integrate ARMs target pretest scripts: DONE
Identify list of benchmarks: DONE
Download benchmarks: DONE
Write Monkeyrunner script for Linpack: DONE
Write Monkeyrunner script for Quadrant: DONE
Write Monkeyrunner script for Antutu benchmark-59: DONE
Write Monkeyrunner script for Geekbench 2 : DONE
Add a workaround to show good battery health needed for Vellamo to run: DONE
Write Monkeyrunner script for Vellamo : DONE
Write Monkeyrunner script for Andebench : DONE
Write Monkeyrunner script for Nbench (from google play) : DONE
Write Monkeyrunner script for GLBenchmark 2.1.4-10 : DONE
Test: DONE

This blueprint contains Public information 
Everyone can see this information.