Automate ARM benchmark application

Registered by vishal on 2012-06-25

Why?
We have automated a set of benchmark applications recomended by ARM at:
https://linaro-private.git.linaro.org/gitweb?p=people/bhoj/benchmarks.git;a=summary

We need to integrate Caffeine Mark to complete the set of benchmark apps recomended by ARM.

Currently these apps run for 720P resolution only for Panda and snowball. We need to add support for Origen which runs at 1024x600 resolution and Panda at 1080P resolution.

Context?
This is part of the larger ARM benchmarking effort.

What gets produced?
A git with scripts that can run each benchmark that has been integrated into each build.

Where will the work get put?
A script on android.git.linaro.org.

Blueprint information

Status:
Complete
Approver:
Zach Pfeffer
Priority:
High
Drafter:
vishal
Direction:
Approved
Assignee:
vishal
Definition:
Approved
Series goal:
Accepted for 2012q2
Implementation:
Implemented
Milestone target:
milestone icon 12.07
Started by
Zach Pfeffer on 2012-07-03
Completed by
vishal on 2012-07-23

Related branches

Sprints

Whiteboard

Notes:
[2012/7/2 pfefferz] Please put notes here.
[2012/7/9 vishalbhoj] Removing Geekbench2-202007. Clarified with ARM about it and there is no other version of Geekbench to be integrated. Also implemented Waiting for benchmark to end by parsing the log for Antutu instead of sleep. The parsing logic could be used for other apps where we have logs specific to completion of benchmark tests.
[2012/7/23 vishalbhoj] We have the benchmarks running for origen. Quadrant,GLBenchmark and Vellamo are failing due to DNS not being set properly on origen. Here is the build for origen: https://android-build.linaro.org/builds/~linaro-android/origen-ics-gcc47-samsunglt-stable-blob/#build=94 .On Tracking-panda the tests are failing due to ddms failing to capture image and is being tracked through the bug: https://bugs.launchpad.net/linaro-android/+bug/1028037

Meta:
Roadmap id: ANDROID2012-BENCHMARKING-PLATFORM
Headline: The benchmarking apps run on Snowball Panda and Origen.
Acceptance: The benchmarking apps run on Snowball Panda and Origen

(?)

Work Items

Work items:
Write Monkeyrunner script for Caffeine mark : DONE
Add support for Origen at 1024x600 : DONE
Add support for Panda at 1920x1080: DONE
Analyze the scope on improving the scripts: DONE
Implement log parser for a specific logs: DONE

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.