[Plugins, EDP] Add Ability to Run Spark Jobs on Cloudera Clusters 5.[3|4].0
The feature adds ability to execute Spark jobs on clusters with Cloudera 5.3.0 and 5.4.0
This implementation works on Ubuntu and CentOS.
Blueprint information
- Status:
- Complete
- Approver:
- Sergey Lukjanov
- Priority:
- Undefined
- Drafter:
- Alexander Aleksiyants
- Direction:
- Approved
- Assignee:
- Oleg Borisenko
- Definition:
- Approved
- Series goal:
- Accepted for liberty
- Implementation:
-
Implemented
- Milestone target:
- None
- Started by
- Vitalii Gridnev
- Completed by
- Vitalii Gridnev
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Spark jobs in Cloudera 5.3.0 plugin are now supported.
Addressed by: https:/
Spark jobs in Cloudera 5.3.0 plugin are now supported. Required unit tests have been added.
Addressed by: https:/
Specification for spark-jobs-
Addressed by: https:/
Specification for spark-jobs-
Addressed by: https:/
Add SPARK_YARN_
Work Items
Work items:
Spark job class for Cloudera: DONE
Spark job class for Spark: DONE
Spark job engine: DONE
Dependency tree
* Blueprints in grey have been implemented.
