Get number of daily builds under control on android-build

Registered by Данило Шеган

We have too many android-build daily builds at the moment. We want to have a better understanding of where they are coming from and to kill any that are not really needed because they are straining our resources (disk, money).

Blueprint information

Status:
Complete
Approver:
Данило Шеган
Priority:
Medium
Drafter:
Paul Sokolovsky
Direction:
Approved
Assignee:
Paul Sokolovsky
Definition:
Approved
Series goal:
Accepted for trunk
Implementation:
Implemented
Milestone target:
milestone icon 2012.06
Started by
Paul Sokolovsky
Completed by
Paul Sokolovsky

Related branches

Sprints

Whiteboard

[pfalcon 2012-04-25] We have 28 daily Android builds at this moment, those alone account for 2000+ XLARGE hours a month. Adding WI to not do daily builds on weekends, as it allows for up to 25% cost saving without any drawbacks.
[pfalcon 2012-04-27] Due to urgent Android restricted builds BP, less than 50% of this BP was implemented, proposed to move it altogether to 2012.04.
[dzin 2012-04-27] Moved to 12.05
[pfalcon 2012-05-08] Daily builds on Saturdays disabled weekend of May 5
[danilo, 2012-05-08] Split out of https://blueprints.launchpad.net/linaro-android-infrastructure/+spec/ec2-android-infra-monitoring
[pfalcon 2012-05-14] Common queries for query-jobs utils are in README directly by its side: http://bazaar.launchpad.net/~linaro-infrastructure/linaro-android-build-tools/trunk/view/head:/utils/query-jobs/README
[pfalcon 2012-05-15] Discussed builds retention policy with Deepti and Fathi, we're on same line of 90 days/100 latest builds for all Jenkins services.
[pfalcon 2012-05-22] We have 41 repeating jobs running on ci.linaro.org. Large subset of those (precise-armhf-*) run twice a day, according to Fathi. Let's see this months bill and have discussion at Connect before deciding for further actions though.
[pfalcon 2012-05-23] "Review/set up rules/processes to run daily builds" - sent email summarizing rules/processes we have now in place, and what proposals/possible improvements which can be applied.

Meta:
Headline: A process is in place to facilitate better daily build usage and keep costs manageable.
Acceptance:We can easily see the number of daily builds we have on android-build and we have a process that makes people consider costs of daily builds before setting them up.

(?)

Work Items

Work items for 2012.05:
Improve handling on Jenkins build slave logs: DONE
Provide tool to query Jenkins job configs via XPath: DONE
Identify and document Xpath patterns for common tasks (only daily builds for now): DONE
Review daily jobs running on android-build: DONE
Review daily jobs running on ci.linaro.org: DONE
Review/elaborate retention policy for Jenkins builds: DONE
Review/set up rules/processes to run daily builds: DONE
Disable daily builds on Saturdays: DONE

Work items:
[deeptik] Apply retention policy to ci.linaro.org: DONE

This blueprint contains Public information 
Everyone can see this information.