Light weight Erasure code framework for swift

Registered by Zhou Yuan

High-level blueprint for tracking EC work

Blueprint information

Status:
Started
Approver:
None
Priority:
Medium
Drafter:
Zhou Yuan
Direction:
Approved
Assignee:
John Dickinson
Definition:
Approved
Series goal:
Accepted for future
Implementation:
Started
Milestone target:
milestone icon ongoing
Started by
John Dickinson

Related branches

Sprints

Whiteboard

Joe writes "The design goal is to be able to have erasure-coded storage plus replicas coexisting in a single Swift cluster." See http://swiftstack.com/blog/2013/07/10/erasure-codes-with-openstack-swift/

Gerrit topic: https://review.openstack.org/#q,topic:bp/swift-ec,n,z

Addressed by: https://review.openstack.org/51497
    Replicator: Add Storage Policy Support

Addressed by: https://review.openstack.org/52194
    Add storage policy support for the Replicator

Addressed by: https://review.openstack.org/56300
    Misc Minor Fixes for Storage Policies

Addressed by: https://review.openstack.org/104713
    Initial Erasure Code Docs

Addressed by: https://review.openstack.org/110944
    A few minor updates to the living EC end user docs

Addressed by: https://review.openstack.org/112036
    Updates to EC design spec from EC design meet-up

Addressed by: https://review.openstack.org/112037
    Updates to EC user docs from EC design meet-up

Addressed by: https://review.openstack.org/112449
    Allow Diskfile to choose whether to cleanup old files per policy

Addressed by: https://review.openstack.org/116486
    Updates to EC Design Spec

Addressed by: https://review.openstack.org/124594
    Allow DELETE operation to remove all datafile

Addressed by: https://review.openstack.org/124596
    EC: GET path in object server

Addressed by: https://review.openstack.org/125190
    Updates to EC design spec

Addressed by: https://review.openstack.org/169614
    Add support for policy types, 'erasure_coding' policy

Addressed by: https://review.openstack.org/169615
    Initial Erasure Code Docs

Addressed by: https://review.openstack.org/169620
    Update test infrastructor

Addressed by: https://review.openstack.org/169985
    Add support for policy types, 'erasure_coding' policy

Addressed by: https://review.openstack.org/169986
    Update test infrastructor

Addressed by: https://review.openstack.org/169990
    Initial Erasure Code Docs

Addressed by: https://review.openstack.org/170666
    Fix account reaper for > 3 replicas

Addressed by: https://review.openstack.org/173398
    Merge EC feature into master

Gerrit topic: https://review.openstack.org/#q,topic:bug/1437442,n,z

Addressed by: https://review.openstack.org/175866
    Merge branch 'master' into feature/crypto

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.