Integrate fault tolerant monkey runs

Registered by Zach Pfeffer on 2012-05-14

Why?
Monkey is a great tool for testing Android. We need to create a few Monkey profiles that can run in LAVA that are targeted to run for long periods of time.

Context?
We do this as part of our general platform effort.

What gets produced?
A LAVA script that gets included in each build.

Where will the work get put?
LAVA

Blueprint information

Status:
Complete
Approver:
Zach Pfeffer
Priority:
Medium
Drafter:
Chengjie HE
Direction:
Approved
Assignee:
Chengjie HE
Definition:
Approved
Series goal:
Accepted for 2012q2
Implementation:
Implemented
Milestone target:
milestone icon 12.07
Started by
Chengjie HE on 2012-06-11
Completed by
Zygmunt Krynicki on 2012-07-05

Related branches

Sprints

Whiteboard

Notes:
[2012/5/14 pfefferz] Put notes here.
[2012/6/25 pfefferz] No BP update by release date. Resource left. Shifting to backlog, pending more info.
[2012/6/27 pfefferz] Looks like liuyq and zyga are going to help close this out. Putting back on 12.07[
[2012/6/28 zkrynicki] Created https://android-build.linaro.org/builds/~zkrynicki/panda-ics-gcc47-tilt-tracking-longmonkey-blob/ and started a test build with the special long monkey run in LAVA
[2012/6/28 zkrynicki] Initial ran failed due to network problems, it could also be related by the vast amount of errors logged on the serial line (that may confuse lava). Logs available here: http://validation.linaro.org/lava-server/dashboard/streams/private/team/linaro/android-daily/bundles/8e062b2bc5277a1ae0395e8cdbb9f189668bbb78/e1869392-c163-11e1-9729-68b599be548c/attachments/85208/
[2012/7/3 zkrynicki] Updated all official and omapzoom builds, waiting for results to show up
[2012/7/5 zkrynicki] Results are inconclusive, it seems that long monkey for five seconds less than regular monkey: https://android-build.linaro.org/builds/~linaro-android/panda-ics-gcc47-tilt-tracking-blob/#build=114
[2012/7/5 zkrynicki] Closed after consulting with pfefferz
[2012/7/6 zkrynicki] Long monkey works but crashes on the new test apks that are present in our current images. The same problem affects regular monkey so I think that this blueprint is fully complete and we need to work on handing test images better in a separate blueprint.

Meta:
Roadmap id: PLATFORM-WORK
Headline: Fault tolerant Monkeyrunner tests are running in the lab
Acceptance: 1 or more monkey tests have been integrated into the lab

(?)

Work Items

Work items:
Run monkey on the target with various configuration options: DONE
Find configuration options that allow monkey to run for 1 to many hours: DONE
Put each configuration into LAVA: DONE
Talk to the LAVA team to give them a heads up that a monkey test is going to run for many hours: DONE
[liuyq0307] Land the long_monkey capable lava-android-test to production: DONE
[zyga] Create a build in android-build that runs the monkey test for many hours: DONE
[zyga] Shift main builds to run this test case: DONE

This blueprint contains Public information 
Everyone can see this information.