Storage Sharding
Implement driver-agnostic storage sharding. Will work with any backend. Optional (disabled by default). Transport will call a storage "lookup" function instead of getting a direct reference to a driver object.
This will allow Marconi to support queue "flavors" with different performance/
Blueprint information
- Status:
- Complete
- Approver:
- Flavio Percoco
- Priority:
- Essential
- Drafter:
- None
- Direction:
- Approved
- Assignee:
- Allele Dev
- Definition:
- Approved
- Series goal:
- Accepted for icehouse
- Implementation:
-
Implemented
- Milestone target:
-
2014.1
- Started by
- Kurt Griffiths
- Completed by
- Allele Dev
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
WIP
Addressed by: https:/
Use oslo.config directly instead of common.config
Addressed by: https:/
feat: storage sharding schema for marconi-queues
Addressed by: https:/
feat: split queues API into public/admin
Addressed by: https:/
feat: add shard management resource
Addressed by: https:/
feat: shards storage controller interface
Addressed by: https:/
feat: shards mongodb driver + tests
Addressed by: https:/
feat: integrate shard storage with transport
Addressed by: https:/
fix(queues): Global config used everywhere
Addressed by: https:/
Setup storage pipeline in the boostrap instead of driver base
Addressed by: https:/
chore: Remove GC cruft from storage driver base class
Addressed by: https:/
feat: add catalogue storage driver for queues
Gerrit topic: https:/
Gerrit topic: https:/
Gerrit topic: https:/
Addressed by: https:/
chore: Pass cache into drivers
Addressed by: https:/
feat: connect sharding manager to control drivers (WIP)
Addressed by: https:/
feat(shard): queue listing from multiple sources
Addressed by: https:/
feat(sharding): Cache shard mappings
Addressed by: https:/
DEBUGGING PATCH - DO NOT MERGE!
Addressed by: https:/
fix(mongo): Delete claimed message fails
Gerrit topic: https:/
Addressed by: https:/
Remove proxy code
