Integration of the Intel Distributon of Apache Hadoop with Savanna
IDH plugin with following features:
* Install and provision Intel Hadoop Manager and Intel Hadoop
* Attach Cinder volumes to VMs with Intel Hadoop. Cinder volumes will be used for HDFS
* Manual cluster scaling
* Swift integration [*]
* Cluster configs - the same configs as in Vanilla Hadoop
* Configs validation - the same as in Vanilla plugin
[*] Swift integration is an important point. Swift is de-facto cloud storage in OpenStack environment for permanent data. But it is not a replacement for HDFS.
What it requires to integrate IDH with Swift? We only need to include jar file with implementation of SwiftFileSystem for Hadoop and update core-site.xml to include this implementation. And we already have this integrated IDH with Swift.
Blueprint information
- Status:
- Complete
- Approver:
- Sergey Lukjanov
- Priority:
- High
- Drafter:
- Joseph D Natoli
- Direction:
- Approved
- Assignee:
- Joseph D Natoli
- Definition:
- Approved
- Series goal:
- Accepted for icehouse
- Implementation:
-
Implemented
- Milestone target:
-
2014.1
- Started by
- Joseph D Natoli
- Completed by
- Sergey Lukjanov
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Adding IDH plugin basic implementation
Addressed by: https:/
Adding IDH plugin basic implementation
Addressed by: https:/
Adding IDH plugin basic implementation
Addressed by: https:/
Added IDH plugin to savanna config
