Verify checksum on object GETs
An idea from irc:jeremyb was to perform content checksum validation during object GETs to more quickly detect bit-rot errors for often used files. The background object-auditor should eventually detect these errors but may take while; and bad files would be served the during the entire time lapse between the bit-rot and detection.
Blueprint information
- Status:
- Complete
- Approver:
- Chuck Thier
- Priority:
- Medium
- Drafter:
- gholt
- Direction:
- Needs approval
- Assignee:
- David Goetz
- Definition:
- Approved
- Series goal:
- Accepted for 1.3
- Implementation:
-
Implemented
- Milestone target:
- None
- Started by
- Thierry Carrez
- Completed by
- Thierry Carrez
Whiteboard
If the load ends up being too high to checksum on every object GET, it could be tuned to checksum only a random selection, or to only checksum if it hadn't been performed in x amount of time.
If the checksum fails, that particular request would receive a bad copy, but the object server should immediately quarantine the object so no further bad copies are served and the object replicator would replicate a copy from another object server.
