Deliver and announce beta stage of kernel CI service

Registered by Alexander Sack

Review all current kernel CI builds and file bugs for problems; CI builds can have problems at various stages:
 * build
 * packaging
 * hwpacksubmit
 * lava-scheduling
 * lava-deployment
 * lava-test-execution ('lava' testrun must succeed - which indicates that deployment and boot of images succeeded)
 * lava-result-reporting

Fix bugs found during the review above.

Create wiki home for the Infrastructure CI service; link owner, launchpad home, ci.linaro.org from that page.

Define and describe a lightweight process that clarifies how teams can request to be setup for kernel CI; include that info in the wiki.

Give brief documentation how to track build failures and how to find the lava job results in the dashboard

Prepare announce mail giving linaro-dev and linaro-kernel community a heads up that the CI service is now fully operational and describe where they can track builds and runtime failures. Point to the wiki home and also explain the process how teams can opt into kernel CI.

Blueprint information

Status:
Complete
Approver:
Alexander Sack
Priority:
High
Drafter:
Deepti B. Kalakeri
Direction:
Approved
Assignee:
Deepti B. Kalakeri
Definition:
Approved
Series goal:
Accepted for engineering
Implementation:
Implemented
Milestone target:
milestone icon 2011.09
Started by
Deepti B. Kalakeri
Completed by
Alexander Sack

Related branches

Sprints

Whiteboard

[asac, Sep 9, 2011]: first work item needs to be split up and it has to be clearer what should be done there; the summary suggests to do an explicit review of all builds as first step and file bugs + attach them to this blueprint; so something like: "review loop of linux-next trees, file bugs and drop summary comment: TODO" could be a work item. you could also have one work item that reflects that you are working on the bugs (but bugs attached to blueprint are implicit work items, so we can live without it ... just gives subscriiber a better feedback imo to have such a work item go to inprogress and when all bugs are fixed set to DONE - or might even be that you decide that some bug isnt a blocker, then you have to drop comment why you decided to not have this bug fixed for this blueprint
[asac, Sep 15, 2011]: added work item to redirect http://ci.linaro.org to https://ci.linaro.org
[deepti, Sep28, 2011]: Set up a new high level wiki to giving links to various CI services and links and addressed asac's comments on the same.
[deepti, Sep28, 2011]: Its been decided that Nicolas Pitre has to be notified about the build results for linux linaro 3.0 and that the status of everything else will be looked up by subscribing to the RSS feeds.
[deepti, Sep29 2011] The Work item for verifying the linux(linus) is set to POSTPONE because of the bug Bug #859473: "Illegal instruction" hints when run stream and posixtestsuite. The investigations for the same are still under progress and hence the item would need to be postponed. The linux(linus) builds are failing during the LAVA test execution side only after the Sep23 builds and hence these issues seems to be induced after sep22 in the linux(linus) tree. Here is the link to one of the successful test execution before it started failing due to the above bug http://validation.linaro.org/lava-server/dashboard/streams/anonymous/ci-linux/bundles/c1e64b9186ca3e55de11744c063798d2771e023e/. Hence I think the bug can be postponed to be resolved for the 11.10 release and we can change this BP to be implemented otherwise.

Headline: The Linaro Infrastructure Team has completed the first stage of the kernel CI service and is proud to open the program up to initial users. Get in contact with the Infrastructure Team or file a bug against the linaro-ci launchpad project if you want your kernel tree/defconfig to be continuously build tested and runtime tested for board types supported in LAVA.

Acceptance: Continous Kernel CI build and LAVA execution fully operational for selected boards; currently CI service tracks linux-linaro, linux (linus), arm-soc/for-next and linux-next trees for a selection of member board defconfig; more to be added. Simple Wiki home for kernel CI service available and a process to request setup for builds is documented on the wiki; finally an announcement mail about service availability and process was sent to linaro-dev and linaro-kernel. http://ci.linaro.org directs to the jenkins interface and not to the current file browser.

(?)

Work Items

Work items:
add redirect from http://ci.linaro.org to https://ci.linaro.org to ensure that the UI view is always accessed: DONE
Review Kernel CI build for linux-linaro for omap2 defconfig, quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review Kernel CI build for linux (linus) for omap2 defconfig, quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review Kernel CI build for arm-soc/for-next for omap2 defconfig, quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review Kernel CI build for linux-next trees for omap2 defconfig, quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review hwpack submit job for linux-linaro for omap2 defconfig, quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review hwpack submit job for linux (linus) for omap2 defconfig, quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review hwpack submit job for arm-soc/for-next for omap2 defconfig , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review hwpack submit job for linux-next trees for omap2 defconfig, quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel CI build status information submitted to LAVA for linux-linaro for omap2 defconfig includes all the important metadata information for the kernel build , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify Kernel the CI build status information submitted to LAVA for linux (linus) for omap2 defconfig includes all the important metadata information for the kernel build , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel CI build status information submitted to LAVA for arm-soc/for-next for omap2 defconfig includes all the important metadata information for the kernel build , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel CI build status information submitted to LAVA for linux-next for omap2 defconfig trees includes all the important metadata information for the kernel build , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel test JSON submitted to LAVA for linux-linaro for omap2 defconfig trees includes all the important metadata information for the kernel tests run , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel test JSON submitted to LAVA for linux (linus) for omap2 defconfig trees includes all the important metadata information for the kernel tests run , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel test JSON submitted to LAVA for arm-soc/for-next for omap2 defconfig trees includes all the important metadata information for the kernel tests run , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel test JSON submitted to LAVA for linux-next for omap2 defconfig trees includes all the important metadata information for the kernel tests run , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel test submitted to LAVA for linux-linaro for omap2 defconfig finishes successfully and that at least all lava job stages including deployment of the image worked well , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel test submitted to LAVA for linux (linus) for omap2 defconfig finishes successfully and that at least all lava job stages including deployment of the image worked well , quick fix or file bugs for missing features and improvements ; attach bugs to BP: POSTPONED
Review/Verify the Kernel test submitted to LAVA for arm-soc/for-next for omap2 defconfig finishes successfully and that at least all lava job stages including deployment of the image worked well , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Review/Verify the Kernel test submitted to LAVA for arm-soc/for-next for omap2 defconfig finishes successfully and that at least all lava job stages including deployment of the image worked well , quick fix or file bugs for missing features and improvements ; attach bugs to BP: DONE
Get the list of people who needs to be notified about the kernel build failures : DONE
Include the names of the people who needs to be notified regarding the kernel build failures in the appropriate jenkins job: DONE
Improve the documentation available @ https://wiki.linaro.org/Platform/Infrastructure/LinaroCIBuildTestService with the details of process to request setup for build : DONE
Make an announcement of the Kernel CI service to linaro-dev and linaro-kernel : DONE

This blueprint contains Public information 
Everyone can see this information.