Verify checksum on object GETs

Registered by gholt on 2010-12-28

An idea from irc:jeremyb was to perform content checksum validation during object GETs to more quickly detect bit-rot errors for often used files. The background object-auditor should eventually detect these errors but may take while; and bad files would be served the during the entire time lapse between the bit-rot and detection.

Blueprint information

Status:
Complete
Approver:
Chuck Thier
Priority:
Medium
Drafter:
gholt
Direction:
Needs approval
Assignee:
David Goetz
Definition:
Approved
Series goal:
Accepted for 1.3
Implementation:
Implemented
Milestone target:
None
Started by
Thierry Carrez on 2011-03-17
Completed by
Thierry Carrez on 2011-03-29

Sprints

Whiteboard

If the load ends up being too high to checksum on every object GET, it could be tuned to checksum only a random selection, or to only checksum if it hadn't been performed in x amount of time.

If the checksum fails, that particular request would receive a bad copy, but the object server should immediately quarantine the object so no further bad copies are served and the object replicator would replicate a copy from another object server.

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.