Cluster Computing in the Cloud

Registered by Dustin Kirkland  on 2009-04-23

The elastic nature of cloud computing is interesting to some traditional cluster computing customers who have workloads that have tremendous spikes and valleys. When these people need computing resources, they need a lot of it (hundreds, potentially thousands of cores). But their workloads (often cpu-intensive models) do not need to run all the time (like a webserver, or mailserver).

For these reasons, the pay-as-you-go and elastic nature of cloud computing is interesting.

In some cases, some infrastructure could actually help present resources available in a cloud as a unified system. See:
 * Condor
  - http://www.cs.wisc.edu/condor/

In other cases, it's a matter of providing parallel programming libraries that are notably missing from Ubuntu. See:
 * mpich2
  - http://www.mcs.anl.gov/research/projects/mpich2/

This blueprint suggests that the Ubuntu server, as guests within a cloud computing system could and should provide the resources needed by cluster computing customers.

:-Dustin

Blueprint information

Status:
Complete
Approver:
Rick Clark
Priority:
Medium
Drafter:
Dustin Kirkland 
Direction:
Approved
Assignee:
Dustin Kirkland 
Definition:
Approved
Series goal:
Accepted for karmic
Implementation:
Implemented
Milestone target:
milestone icon karmic-alpha-5
Started by
Dustin Kirkland  on 2009-06-25
Completed by
Dustin Kirkland  on 2009-09-04

Related branches

Sprints

Whiteboard

= Status =

== MPICH2 ==
 * Packaged, in Karmic Universe

== Condor ==
 * Packaged, in Karmic Universe

-- Dustin Kirkland

-----------------------------------------------
Discussion Points:
 * Define difference between cloud and grid
 * Why cloud is interesting to grid computing customers?
 * Discuss advantages/limitations of the cloud for grid users
 * Identify the low hanging fruit
  * Some new request-for-packaging (mpich2, condor, ...)
 * Looking a bit further out, what are the higher cost, greater return on investment work items in this space?
-- Dustin Kirkland
 * Howto build a virtualized SGE cluster on top of a hybrid cloud using OpenNebula
-- Tino Vazquez

(?)

Work Items