Integrate Android Benchmarks Run by ARM
ARM has verified the following Android benchmark applications:
* Linpack
* Quadrant
* Geekbench 2 ( from google play)
* Geekbench 2-202007 ( benchmark team)
* Vellamo
* Andebench
* Antutu Benchmark-59
* Caffeine mark
* Nbench (from google play)
* GLBenchmark 2.1.4-10
Rest are browser based benchmarks (e.g. bbench, browsermark etc). We will integrate these into the build and test them. If DS-5 is available, we'll use DS-5 to profile.
[Ashwin]:
Make sure that background load is less than 0.5%. You can confirm this by profiling idle state after booting up the board.
For profiling you should disable CPU throttling using the following command. This will ensure that CPU is clocked at 1GHz (for Snowball) in running mode. With fixed CPU clock, analysis becomes easy.
echo performance > /sys/devices/
Blueprint information
- Status:
- Complete
- Approver:
- Zach Pfeffer
- Priority:
- High
- Drafter:
- vishal
- Direction:
- Approved
- Assignee:
- vishal
- Definition:
- Approved
- Series goal:
- Accepted for 2012q2
- Implementation:
-
Implemented
- Milestone target:
-
12.06
- Started by
- Amit Pundir
- Completed by
- Zach Pfeffer
Related branches
Related bugs
Sprints
Whiteboard
Notes:
[2012/5/31 pfefferz]: Put notes here.
[2012/6/7 pundiramit]: Downloaded all the apps except Geekbench, and Caffeine. Couldn't locate/download them.
[2012/6/12 vishalbhoj]: To take care of variance we are doing this:
1.Network activity disabled (like wifi and ethernet) .
2.Set cpufreq governor to performance to stay at max possible frequency.
3.Kill background processes with activity manager (am kill-all).
4.Run Benchmarking application in automated fashion using monkeyrunner.
[2012/6/25 pfefferz] Splitting remaining work into: https:/
https:/
Meta:
Headline: The set of Android benchmarks that were run by ARM have been integrated into LAVA
Acceptance: The set of Android benchmarks that were run by ARM have been integrated into LAVA
Work Items
Work items:
Integrate ARMs target pretest scripts: DONE
Identify list of benchmarks: DONE
Download benchmarks: DONE
Write Monkeyrunner script for Linpack: DONE
Write Monkeyrunner script for Quadrant: DONE
Write Monkeyrunner script for Antutu benchmark-59: DONE
Write Monkeyrunner script for Geekbench 2 : DONE
Add a workaround to show good battery health needed for Vellamo to run: DONE
Write Monkeyrunner script for Vellamo : DONE
Write Monkeyrunner script for Andebench : DONE
Write Monkeyrunner script for Nbench (from google play) : DONE
Write Monkeyrunner script for GLBenchmark 2.1.4-10 : DONE
Test: DONE
