Prebuilt images artifacts archived on s.l.o does not appear on the destination folder

Bug #977120 reported by Deepti B. Kalakeri
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Linaro CI
Fix Released
Medium
Deepti B. Kalakeri

Bug Description

prebuilt images are now archived successfully on snapshots.linaro.org.
Though the script (/home/linaro-ci-publish/linaro-license-protection/scripts/publish_to_snapshots.py) which moves the hwpack to a permanent location on s.l.o is able to move the artifacts from source on s.l.o /srv3/snapshots.linaro.org/uploads/oneiric-armel-pre-built-images/ ' to destination '/srv3/snapshots.linaro.org/www/oneiric, they seem to not show up in the destination folder for example /srv3/snapshots.linaro.org/www/oneiric/lt-mx5-oneiric/20120408/1/images/.

Here is the job which publishes the snapshots.linaro.org: https://ci.linaro.org/jenkins/view/Ubuntu%20Build%20Service/job/oneiric-armel-pre-built-images/95/console along with the successful move of the same to destination by the script /home/linaro-ci-publish/linaro-license-protection/scripts/publish_to_snapshots.py to /srv3/snapshots.linaro.org/www/oneiric .

Apart from the above script /home/linaro-ci-publish/linaro-license-protection/scripts/publish_to_snapshots.py working on destination directory /srv3/snapshots.linaro.org/www/oneiric/ , we have regular rsync operation executed by script /home/snapshots-linaro/bin/offspring-linaro-snapshots which also works on the same directory /srv3/snapshots.linaro.org/www/oneiric/. I went through the script /home/snapshots-linaro/bin/offspring-linaro-snapshots and does not seem like it will be harmful to our moved artifacts.

This needs further investigation as to why the moved files are not listed in the destination directory or what is causing the problem and where they are disappearing.

Changed in linaro-ci:
milestone: none → 2012.04
Revision history for this message
Deepti B. Kalakeri (deeptik) wrote :

The rysnc script that runs on the oneiric directory deletes any of the new contents that is added to the directory and retains only the things updated by snapshot-linaro user. The solution is to stop the rsync script to delete the additional files being added to the directory. IS is ready to apply the changes to the rsync script. But, before we asked IS to do implement the solution, we decided that we would probably move on to the precise pre built images than spend time on something which is going to be old.

Thanks!!
Deepti.

Changed in linaro-ci:
assignee: nobody → Deepti B. Kalakeri (deeptik)
status: New → In Progress
importance: Undecided → Medium
status: In Progress → Triaged
Revision history for this message
Fathi Boudra (fboudra) wrote :

Darren has disabled --delete from rsync script. Set to Fix-released.

Changed in linaro-ci:
status: Triaged → Fix Released
Revision history for this message
Deepti B. Kalakeri (deeptik) wrote : Re: [Bug 977120] [NEW] Prebuilt images artifacts archived on s.l.o does not appear on the destination folder

I checked yesterday on mombin. I did not see the artifacts being
retained in the destination dir. I will check one more time.

On 4/21/12, Fathi Boudra <email address hidden> wrote:
> Darren has disabled --delete from rsync script. Set to Fix-released.
>
> ** Changed in: linaro-ci
> Status: Triaged => Fix Released
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/977120
>
> Title:
> Prebuilt images artifacts archived on s.l.o does not appear on the
> destination folder
>
> Status in Linaro Continuous Integration:
> Fix Released
>
> Bug description:
> prebuilt images are now archived successfully on snapshots.linaro.org.
> Though the script
> (/home/linaro-ci-publish/linaro-license-protection/scripts/publish_to_snapshots.py)
> which moves the hwpack to a permanent location on s.l.o is able to move the
> artifacts from source on s.l.o
> /srv3/snapshots.linaro.org/uploads/oneiric-armel-pre-built-images/ ' to
> destination '/srv3/snapshots.linaro.org/www/oneiric, they seem to not show
> up in the destination folder for example
> /srv3/snapshots.linaro.org/www/oneiric/lt-mx5-oneiric/20120408/1/images/.
>
> Here is the job which publishes the snapshots.linaro.org:
> https://ci.linaro.org/jenkins/view/Ubuntu%20Build%20Service/job
> /oneiric-armel-pre-built-images/95/console along with the successful
> move of the same to destination by the script /home/linaro-ci-publish
> /linaro-license-protection/scripts/publish_to_snapshots.py to
> /srv3/snapshots.linaro.org/www/oneiric .
>
> Apart from the above script /home/linaro-ci-publish/linaro-license-
> protection/scripts/publish_to_snapshots.py working on destination
> directory /srv3/snapshots.linaro.org/www/oneiric/ , we have regular
> rsync operation executed by script /home/snapshots-linaro/bin
> /offspring-linaro-snapshots which also works on the same directory
> /srv3/snapshots.linaro.org/www/oneiric/. I went through the script
> /home/snapshots-linaro/bin/offspring-linaro-snapshots and does not
> seem like it will be harmful to our moved artifacts.
>
> This needs further investigation as to why the moved files are not
> listed in the destination directory or what is causing the problem and
> where they are disappearing.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/linaro-ci/+bug/977120/+subscriptions
>

--
Sent from my mobile device

Thanks and Regards,
Deepti
Infrastructure Team Member, Linaro Platform Teams
Linaro.org | Open source software for ARM SoCs
Follow Linaro: http://www.facebook.com/pages/Linaro
http://twitter.com/#!/linaroorg - http://www.linaro.org/linaro-blog

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.