json import CLI tool
We need a tool that will make possible to load significant amount of data (gigabytes) in a reasonable time. This should be a CLI tool that represents a thin wrapper on currently implemented magnetdb.storage package.
This tool should receive table name as a command line parameter and read data being imported from file or stdin.
The data should be read string by string, each string is a JSON object, ready to be passed as a parameter for PutItemRequest.
Samle input data:
{"id": {"S": "user1"}, "name": {"S": "John Doe"}, "account": {"N": 123456"}...},
{"id": {"S": "user2"}, "name": {"S": "Jane Doe"}, "account": {"N": 321654"}...},
...
Logging and progress visualization - TBD
Blueprint information
- Status:
- Complete
- Approver:
- Ilya Sviridov
- Priority:
- Low
- Drafter:
- Illia Khudoshyn
- Direction:
- Approved
- Assignee:
- Maksym Iarmak
- Definition:
- New
- Series goal:
- Accepted for 2.0
- Implementation:
- Implemented
- Milestone target:
- 2.0.3
- Started by
- Maksym Iarmak
- Completed by
- Maksym Iarmak
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Add json import CLI tool
Work Items
Dependency tree
* Blueprints in grey have been implemented.