Migrate a Queue Between Pools

Registered by Allele Dev on 2013-12-09

In order to support manual rebalancing (QoS) of a large deployment, there should be a means to migrate a queue from one pool to another. Ideally, a solution to this problem will result in zero to minimal downtime, and if downtime is necessary, it only affects the owner of that particular queue.

Also to consider is migrating a queue as quickly as possible. It can't take days.

Blueprint information

Status:
Not started
Approver:
Kurt Griffiths
Priority:
Low
Drafter:
Allele Dev
Direction:
Needs approval
Assignee:
Flavio Percoco
Definition:
Discussion
Series goal:
Accepted for kilo
Implementation:
Not started
Milestone target:
None

Related branches

Sprints

Whiteboard

Deprioritized for Juno, since we have other things such as v1.1 and graduation that will likely take all our time. (kgriffs)

Noisy neighbor can be addressed by being able to migrate/rebalance shards to progressively less-crowded pools. You can take this to an extreme by isolating someone in their own micro storage cluster using docker. You would want to also be able to handle a queue that is really busy for a while and then "cools down" for a while.

Noisy neighbor doesn't really apply to the web heads because we can just round-robin and autoscale the load
--

Moving to Kilo. I don't believe this will make it into Juno
-- flaper87 2014-08-04

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.