Mistral Dataflow
We need to have a mechanism in Mistral for transferring data between workflow tasks so that we can model more complex algorithms that require manipulations with state shared between individual steps. It should support the following features:
- Task input data in JSON format
- YAQL expression associated with a task to select a subset of input data to process
- Merge data produced by a task back into an input JSON structure
- Merge JSON structures on task graph path intersections
Blueprint information
- Status:
- Complete
- Approver:
- Renat Akhmerov
- Priority:
- Essential
- Drafter:
- Renat Akhmerov
- Direction:
- Approved
- Assignee:
- Renat Akhmerov
- Definition:
- Drafting
- Series goal:
- None
- Implementation:
-
Implemented
- Milestone target:
- None
- Started by
- Nikolay Makhotkin
- Completed by
- Renat Akhmerov
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Working on Data Flow (step 1)
Gerrit topic: https:/
Gerrit topic: https:/
Addressed by: https:/
Add keystone auth_token in context
Gerrit topic: https:/
