$ grep -l -a -E '^Failed to fetch.+s3' * ... 2012-03-06-slave-i-63954a07.log 2012-03-06-slave-i-7d12c119.log 2012-03-06-slave-i-e1c51a85.log 2012-03-07-slave-i-31c66355.log 2012-03-07-slave-i-fbd9029f.log 2012-03-08-slave-i-5961c23d.log 2012-03-08-slave-i-5f40ee3b.log 2012-03-08-slave-i-c97cdfad.log 2012-03-08-slave-i-e59e3281.log 2012-03-09-slave-i-69ec5a0d.log 2012-03-09-slave-i-9bdf69ff.log 2012-03-09-slave-i-b3a81cd7.log 2012-03-10-slave-i-bdb705d9.log 2012-03-10-slave-i-fd1ba899.log 2012-03-11-slave-i-0f59e16b.log 2012-03-12-slave-i-23058647.log 2012-03-12-slave-i-97ed6cf3.log 2012-03-12-slave-i-bb60e0df.log 2012-03-12-slave-i-e79b1b83.log 2012-03-13-slave-i-7d109819.log 2012-03-13-slave-i-ad5cd4c9.log 2012-03-14-slave-i-23ca5947.log 2012-03-14-slave-i-6931a10d.log 2012-03-14-slave-i-8d0a9ae9.log 2012-03-14-slave-i-ebe1728f.log 2012-03-14-slave-i-fb63fe9f.log 2012-03-15-slave-i-fb23b89f.log 2012-03-16-slave-i-e9d3b18d.log 2012-03-17-slave-i-d5b9d2b1.log 2012-03-18-slave-i-c1a3d3a5.log 2012-03-19-slave-i-1f90ef7b.log 2012-03-19-slave-i-f3dea597.log 2012-03-19-slave-i-fbb3d09f.log 2012-03-20-slave-i-bd195fd9.log 2012-03-20-slave-i-bf195fdb.log 2012-03-21-slave-i-1f8cc67b.log 2012-03-21-slave-i-2b5c174f.log 2012-03-21-slave-i-41b6f925.log 2012-03-21-slave-i-795b101d.log 2012-03-21-slave-i-957b37f1.log 2012-03-23-slave-i-2694cd42.log 2012-03-24-slave-i-d8b196bc.log 2012-03-25-slave-i-e2082a86.log 2012-03-26-slave-i-5852663c.log 2012-03-26-slave-i-78e4ce1c.log 2012-03-27-slave-i-70e4d414.log 2012-03-27-slave-i-88cdfbec.log 2012-03-28-slave-i-ce221aaa.log 2012-03-29-slave-i-3ce4e458.log 2012-03-29-slave-i-52919e36.log 2012-03-29-slave-i-5c232238.log 2012-04-02-slave-i-7fff1c18.log 2012-04-03-slave-i-25ff1742.log 2012-04-03-slave-i-271bf040.log 2012-04-03-slave-i-69bb4e0e.log 2012-04-04-slave-i-0f32c068.log 2012-04-04-slave-i-a5a153c2.log
So yes, we're still having it almost everyday, it's just auto-retrying hides it from our eyes.
$ grep -l -a -E '^Failed to fetch.+s3' * 06-slave- i-63954a07. log 06-slave- i-7d12c119. log 06-slave- i-e1c51a85. log 07-slave- i-31c66355. log 07-slave- i-fbd9029f. log 08-slave- i-5961c23d. log 08-slave- i-5f40ee3b. log 08-slave- i-c97cdfad. log 08-slave- i-e59e3281. log 09-slave- i-69ec5a0d. log 09-slave- i-9bdf69ff. log 09-slave- i-b3a81cd7. log 10-slave- i-bdb705d9. log 10-slave- i-fd1ba899. log 11-slave- i-0f59e16b. log 12-slave- i-23058647. log 12-slave- i-97ed6cf3. log 12-slave- i-bb60e0df. log 12-slave- i-e79b1b83. log 13-slave- i-7d109819. log 13-slave- i-ad5cd4c9. log 14-slave- i-23ca5947. log 14-slave- i-6931a10d. log 14-slave- i-8d0a9ae9. log 14-slave- i-ebe1728f. log 14-slave- i-fb63fe9f. log 15-slave- i-fb23b89f. log 16-slave- i-e9d3b18d. log 17-slave- i-d5b9d2b1. log 18-slave- i-c1a3d3a5. log 19-slave- i-1f90ef7b. log 19-slave- i-f3dea597. log 19-slave- i-fbb3d09f. log 20-slave- i-bd195fd9. log 20-slave- i-bf195fdb. log 21-slave- i-1f8cc67b. log 21-slave- i-2b5c174f. log 21-slave- i-41b6f925. log 21-slave- i-795b101d. log 21-slave- i-957b37f1. log 23-slave- i-2694cd42. log 24-slave- i-d8b196bc. log 25-slave- i-e2082a86. log 26-slave- i-5852663c. log 26-slave- i-78e4ce1c. log 27-slave- i-70e4d414. log 27-slave- i-88cdfbec. log 28-slave- i-ce221aaa. log 29-slave- i-3ce4e458. log 29-slave- i-52919e36. log 29-slave- i-5c232238. log 02-slave- i-7fff1c18. log 03-slave- i-25ff1742. log 03-slave- i-271bf040. log 03-slave- i-69bb4e0e. log 04-slave- i-0f32c068. log 04-slave- i-a5a153c2. log
...
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-03-
2012-04-
2012-04-
2012-04-
2012-04-
2012-04-
2012-04-
So yes, we're still having it almost everyday, it's just auto-retrying hides it from our eyes.