Build tests into Android Builds

Registered by Zach Pfeffer on 2012-06-07

Why:
There are many tests that can get built included in AOSP. Modify the builds to include these test in the images we build.

Who:
Zygmunt Krynicki (zyga)

Where:
1) Specific android projects (TBD) (build patches, configuration patches, as needed)
2) Jenkins configuration on android-build.linaro.org (all of official builds)

Context:
The testing card

Blueprint information

Status:
Complete
Approver:
Zach Pfeffer
Priority:
Low
Drafter:
Zygmunt Krynicki
Direction:
Approved
Assignee:
Zygmunt Krynicki
Definition:
Approved
Series goal:
Accepted for 2012q2
Implementation:
Implemented
Milestone target:
milestone icon 12.07
Started by
Zygmunt Krynicki on 2012-06-08
Completed by
Zygmunt Krynicki on 2012-07-23

Related branches

Sprints

Whiteboard

Notes:
[2012/6/7 pfefferz] Put notes here.
[2012/6/? zyga] I'm trying to build the tests into our images. We'll get a separate set of daily builds with the 'tests' variant. Once they compile cleanly and work just as well we can consider dropping the normal builds. I'm still unsure how to run particular tests (needs some research or help from someone that knows). I'd like to be able to run simple 'hello world' tests (based on JUnit) and get the results out
[2012/6/25 zyga] Snowball build blocked by gcc 4.6 bug: https://bugs.launchpad.net/gcc-linaro/+bug/1016070
[2012/6/25 zyga] Panda build updated to reflect current changes in tilt tracking (new kernel, no blobs), build passed
[2012/6/25 zyga] Snowball updated to match non-tests variant, build in progress, need a better way to get notified of configuration changes
[2012/6/25 pfefferz] Good progress was made, but all the builds didn't get switched over. Will shoot for this in 12.07.
[2012/6/28 zkrynicki] Blocked by bug https://bugs.launchpad.net/linaro-android/+bug/1018832 (resolved locally, will push fix to gerrit)
[2012/6/29 zkrynicki] Slowed down by https://bugs.launchpad.net/linaro-android/+bug/10189652
[2012/7/2 zkrynicki] That bug is no longer blocking me (patches waiting for review: http://review.android.git.linaro.org/#change,2359 and http://review.android.git.linaro.org/#change,2358 )
[2012/7/2 zkrynicki] Updated summary to have new Why/Who/Where/Context sections
[2012/7/6 zkrynicki] I've postponed two items that are really a part of a dedicated blueprint (automate-android-tests) and don't belong here anymore. We can remove them zach is okay with that. I've also added a new work item to track if skia tests are built into the image (initial analysis seems to indicate they are not)
[2012-07-23 zkrynicki] Postponed one item, will convert to a bug report
[2012-07-23 zkrynicki] Closing this blueprint

Test build URLs (no longer needed as all official builds include tests)
https://android-build.linaro.org/builds/~zkrynicki/imx6-ics-gcc47-freescalelt-stable-tests-open/
https://android-build.linaro.org/builds/~zkrynicki/vexpress-ics-gcc47-armlt-tracking-tests-open/
https://android-build.linaro.org/builds/~zkrynicki/imx53-ics-gcc47-freescalelt-stable-tests-open/
https://android-build.linaro.org/builds/~zkrynicki/origen-ics-gcc47-samsunglt-stable-tests-blob/
https://android-build.linaro.org/builds/~zkrynicki/snowball-ics-gcc46-igloo-stable-tests-blob/
https://android-build.linaro.org/builds/~zkrynicki/panda-ics-gcc47-tilt-tracking-tests-blob/

The following things reference TARGET_BUILD_VARIANT: https://docs.google.com/spreadsheet/pub?key=0AgiculnRh94adFY1TnVwM1RWcU9KdFV1eExjQThhMGc&output=html

Meta:
Headline: All tests are now included in the build
Acceptance: All tests are now included in the build

(?)

Work Items

Work items:
Get a stable panda build to assist in learning: DONE
Consider using TARGET_BUILD_VARIANT=test: DONE
Check if TARGET_BUILD_VARIANT=test removes anything we care about: DONE
Announce intent to switch on 29th June on linaro-android: DONE
Figure out how we get system.tar.bz2 and if it could omit tests (by accident or deliberately): DONE
Get access to android-build.linaro.org: DONE
Get edit access for official builds: DONE
Setup parallel 'tests' builds on https://android-build.linaro.org: DONE
Suspend parallel 'tests' builds: DONE
Switch official builds to use 'tests' variant: DONE
Update tests to build with the Linaro toolchain: DONE
Investigate how build system tags affect what is installed: DONE
Attempt to run connectivity manager tests locally: POSTPONED
Verify select tests: POSTPONED
Fix issues marked as 'bad' in the google document linked above: POSTPONED
Discuss how representative 'panda-ics-tracking' is vs other builds, maybe redo that document for them: DONE
Check if skia tests are actually being built into the image: DONE

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.