Glance Swift Store to use Multiple Containers for Storing Images

Registered by Hemanth Makkapati

Glance, when configured to use Swift store in Single Tenant Mode, stores images in one container as indicated by the configuration option, swift_store_container. This approach of storing images in ONE container
is subject to performance bottleneck.

Storing images in one container is prone to Swift rate-limiting on containers. Swift is equipped with container rate-limiting that can throttle concurrent POST, PUT and DELETE operations in a single container.
This becomes a serious issue in a large scale deployments especially when coupled with smaller segment sizes.

To reduce/overcome the performance bottleneck, we propose the use of multiple containers for storing images in Single Tenant Mode (this change will not affect Multi Tenant Mode because that setup stores each image in its own container). This leads to increased concurrency of image creation and deletion operations.

Blueprint information

Status:
Complete
Approver:
Nikhil Komawar
Priority:
High
Drafter:
Hemanth Makkapati
Direction:
Approved
Assignee:
Ben Roble
Definition:
Approved
Series goal:
Accepted for kilo
Implementation:
Implemented
Milestone target:
milestone icon 2015.1.0
Started by
Nikhil Komawar
Completed by
Nikhil Komawar

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/swift-store-multiple-containers,n,z

Addressed by: https://review.openstack.org/141516
    Update config and docs for Multiple Containers

Addressed by: https://review.openstack.org/125760
    Swift Store to use Multiple Containers

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.