Run Spark jobs on vanilla Hadoop 2.x

Registered by Michael Le

Add ability to submit and run Spark jobs on vanilla Hadoop 2.x.
Work from blueprint: https://blueprints.launchpad.net/sahara/+spec/spark-jobs-for-cdh-5-3-0
adds support for CDH but not for vanilla Hadoop.

Blueprint information

Status:
Complete
Approver:
Sergey Lukjanov
Priority:
Medium
Drafter:
Michael Le
Direction:
Approved
Assignee:
Mikhail
Definition:
Approved
Series goal:
Accepted for newton
Implementation:
Implemented
Milestone target:
milestone icon newton-rc1
Started by
Vitalii Gridnev
Completed by
Vitalii Gridnev

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/spark-jobs-for-vanilla-hadoop,n,z

Addressed by: https://review.openstack.org/201411
    Run Spark jobs on vanilla Hadoop 2.x

Addressed by: https://review.openstack.org/322813
    Merge Vanilla and Spark plugins

Addressed by: https://review.openstack.org/348410
    Spark on Vanilla Clusters

Addressed by: https://review.openstack.org/363728
    Add Spark WordCount job for Vanilla Plugin

(?)

Work Items

Work items:
Draft specification: DONE
Implement for vanilla Hadoop 2.6.0: TODO
Implement for vanilla Hadoop 2.4.1: TODO

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.