Integration of the Intel Distributon of Apache Hadoop with Savanna

Registered by Joseph D Natoli on 2013-10-04

IDH plugin with following features:

* Install and provision Intel Hadoop Manager and Intel Hadoop
* Attach Cinder volumes to VMs with Intel Hadoop. Cinder volumes will be used for HDFS
* Manual cluster scaling
* Swift integration [*]
* Cluster configs - the same configs as in Vanilla Hadoop
* Configs validation - the same as in Vanilla plugin

[*] Swift integration is an important point. Swift is de-facto cloud storage in OpenStack environment for permanent data. But it is not a replacement for HDFS.

What it requires to integrate IDH with Swift? We only need to include jar file with implementation of SwiftFileSystem for Hadoop and update core-site.xml to include this implementation. And we already have this integrated IDH with Swift.

Blueprint information

Status:
Complete
Approver:
Sergey Lukjanov
Priority:
High
Drafter:
Joseph D Natoli
Direction:
Approved
Assignee:
Joseph D Natoli
Definition:
Approved
Series goal:
Accepted for icehouse
Implementation:
Implemented
Milestone target:
milestone icon 2014.1
Started by
Joseph D Natoli on 2013-10-09
Completed by
Sergey Lukjanov on 2014-01-13

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/idh-savanna-plugin,n,z

Addressed by: https://review.openstack.org/50720
    Adding IDH plugin basic implementation

Addressed by: https://review.openstack.org/56105
    Adding IDH plugin basic implementation

Addressed by: https://review.openstack.org/63337
    Adding IDH plugin basic implementation

Addressed by: https://review.openstack.org/66069
    Added IDH plugin to savanna config

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.