Set up automated syncing with AOSP & other upstreams

Registered by Paul Sokolovsky on 2011-08-30

We now have complete AOSP mirror in our Gerrit, with Linaro code on top of it. Last thing left is making sure we sync automatically.

Blueprint information

Status:
Complete
Approver:
James Westby
Priority:
High
Drafter:
Paul Sokolovsky
Direction:
Approved
Assignee:
Paul Sokolovsky
Definition:
Approved
Series goal:
Accepted for trunk
Implementation:
Implemented
Milestone target:
milestone icon 11.12
Started by
Fathi Boudra on 2011-09-09
Completed by
Paul Sokolovsky on 2011-12-09

Related branches

Sprints

Whiteboard

Comments:
[20110830 james-w] Paul, when you set something to blocked please add a comment explaining what is blocking it so that others are aware. Thanks.
[pfalcon 2011-09-22] This BP was moved from 11.09 to 11.10 due to kernel.org/AOSP downtime.
[pfalcon 2011-10-24]
Setting up properly functioning mirror is blocked by having overzealous firewall on android.git.linaro.org, not allowing to access dynamically changing upstream host set, as wanted by Android team. This was once reported to IS, but request to open up firewall was rejected. This causes continued delays and waste of effort on setting up mirrors for new and/or changed upstreams. Escalated to the Android Lead, may further escalate to the Platform Lead.
[mansson 2011-10-28] For the above reasons this BP was moved from 11.10 to 11.11.
[dzin 2011/10/28] re-target to 11.11
[pfalcon 2011-11-18] Docs are at https://wiki.linaro.org/Platform/Android/GerritMirroring
[dzin 2011-11-23] Almost done, but due to ICS issues with AOSP mirror, this could not be deplyed as a cronjob. Re-target to 11.12

Headline:
Syncing with AOSP and other upstream projects is now automated.

Acceptance:
Syncing with AOSP and other upstream project we mirror is automatically performed with a set interval.

Work done in 2011.09:
Increase space on android.git.linaro.org (RT): DONE
Open firewall access for git on android.git.linaro.org (RT): DONE

(?)

Work Items

Work items:
Increase space on android.git.linaro.org (RT): DONE
Open firewall access for git on android.git.linaro.org (RT): DONE
Extend mirror to support other uptreams besides AOSP: DONE
Design config scheme to account for all usecases we saw (>1 upstream, host down, non one-too-one mapping, etc.): DONE
Extend mirror to support not one to one mapping of source and destination projects (e.g mirroring foo as bar): DONE
Support other upstream schemes besides git://: DONE
Support partial (per-upsream) syncs instead of all upstreams at once: DONE
Re-add support for manifest as source of upstream project list: DONE
Deploy as cronjob: DONE
Write documentation: DONE

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.