[EDP] Add Spark Shell Action Job Type
While the Oozie engine now supports Shell actions, Spark users do not presently have access to this job type. Its addition would allow the creation of cluster maintenance tools, pre- or post-processing jobs which might be cumbersome to implement in Spark itself, the retrieval of data from filesystems not supported as Sahara data sources, or any other use case possible from a shell command.
Blueprint information
- Status:
- Complete
- Approver:
- Sergey Lukjanov
- Priority:
- Medium
- Drafter:
- Elise Gafford
- Direction:
- Approved
- Assignee:
- Sergey Gotliv
- Definition:
- Approved
- Series goal:
- Accepted for liberty
- Implementation:
- Implemented
- Milestone target:
- 3.0.0
- Started by
- Sergey Gotliv
- Completed by
- Sergey Lukjanov
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
[EDP] Add Spark Shell Action job type
Addressed by: https:/
Adding support for the Spark Shell job
Addressed by: https:/
Modify launch_command to support global variables