json import CLI tool

Registered by Illia Khudoshyn

We need a tool that will make possible to load significant amount of data (gigabytes) in a reasonable time. This should be a CLI tool that represents a thin wrapper on currently implemented magnetdb.storage package.
This tool should receive table name as a command line parameter and read data being imported from file or stdin.
The data should be read string by string, each string is a JSON object, ready to be passed as a parameter for PutItemRequest.

Samle input data:
{"id": {"S": "user1"}, "name": {"S": "John Doe"}, "account": {"N": 123456"}...},
{"id": {"S": "user2"}, "name": {"S": "Jane Doe"}, "account": {"N": 321654"}...},
...

Logging and progress visualization - TBD

Blueprint information

Status:
Complete
Approver:
Ilya Sviridov
Priority:
Low
Drafter:
Illia Khudoshyn
Direction:
Approved
Assignee:
Maksym Iarmak
Definition:
New
Series goal:
Accepted for 2.0
Implementation:
Implemented
Milestone target:
milestone icon 2.0.3
Started by
Maksym Iarmak
Completed by
Maksym Iarmak

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/bulk-data-load,n,z

Addressed by: https://review.openstack.org/84516
    Add json import CLI tool

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.