[EDP] Add Spark Shell Action Job Type

Registered by Elise Gafford

While the Oozie engine now supports Shell actions, Spark users do not presently have access to this job type. Its addition would allow the creation of cluster maintenance tools, pre- or post-processing jobs which might be cumbersome to implement in Spark itself, the retrieval of data from filesystems not supported as Sahara data sources, or any other use case possible from a shell command.

Blueprint information

Status:
Complete
Approver:
Sergey Lukjanov
Priority:
Medium
Drafter:
Elise Gafford
Direction:
Approved
Assignee:
Sergey Gotliv
Definition:
Approved
Series goal:
Accepted for liberty
Implementation:
Implemented
Milestone target:
milestone icon 3.0.0
Started by
Sergey Gotliv
Completed by
Sergey Lukjanov

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/edp-add-spark-shell-action,n,z

Addressed by: https://review.openstack.org/160972
    [EDP] Add Spark Shell Action job type

Addressed by: https://review.openstack.org/197333
    Adding support for the Spark Shell job

Addressed by: https://review.openstack.org/197315
    Modify launch_command to support global variables

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.