Queue Placement on Storage Nodes
This is essential for scaling and operating a large deployment.
We could use MongoDB's built-in-sharding, or create our own placement algorithm if we need more control since we will likely want to split chunks not based on chunk size, but on request rate.
I propose this be implemented as a placement function/class that is passed into the storage driver on init, and that this placement function/class have it's own configuration section in marconi.conf
This lays the groundwork for supporting other data stores that, unlike Mongo, do not have built-in sharding logic.
Trello: https:/
Blueprint information
- Status:
- Complete
- Approver:
- Flavio Percoco
- Priority:
- Medium
- Drafter:
- Kurt Griffiths
- Direction:
- Needs approval
- Assignee:
- Allan Metts
- Definition:
- Superseded
- Series goal:
- Accepted for havana
- Implementation:
- Not started
- Milestone target:
- None
- Started by
- Completed by
- Kurt Griffiths
Related branches
Related bugs
Sprints
Whiteboard
Superseded by: https:/
Gerrit topic: https:/
Addressed by: https:/
Adds storage placement support