3.An Implementation of a Virtual Cluster on a Cloud

tangibleassistantΛογισμικό & κατασκευή λογ/κού

3 Δεκ 2013 (πριν από 3 χρόνια και 8 μήνες)

100 εμφανίσεις

An  Implementa+on  of  
Virtual  Cluster  on  a  Cloud

Pongsakorn  U-­‐chupala  
Kasetsart  University  
Agenda  


Introduc+on  


Design  &  Implementa+on  


Benchmarking  Results  
Cluster

User

Storage  Farm

GPU  Accelerated  Nodes

Compute  Nodes

Frontend

*Example  setup

High-­‐speed  
Network

Virtual

Managing  virtual  cluster  
Manually  
is  a  
Headache  
hMp://
openphoto.net
/gallery/
image.html?image_id
=24436  
Virtual  Cluster  Cloud

User

Virtual  Cluster

Virtual  Cluster  Template

*Not  limited  to  Rocks  Cluster

Mul+-­‐site  Infrastructure

Thailand

USA

Japan

*Countries  listed  are  just  for  examples

Overlay  Network  
Design  Goals



Automa1c
 resources  management  


Designed  with  
scalability
 in  mind  


Acceptable  
performance  


Virtual  Cluster  management  as  a  
single  en1ty  


Create  


Deploy  


Suspend  


Stop  


Delete  
Agenda  


Introduc+on  


Design  &  Implementa+on  


Benchmarking  Results  
Architecture  
OpenNebula
Resource Site 1 (Rocks)
onevc extension
VM-Container
VM-Container
Resource
Site 2
Virtual Infrastructure
Overlay Network
Physical Resource
Multi-tier VPN
Mul+-­‐+er  VPN  
Site 1
Primary VPN Server
VM-Container
VM-Container
Site 2
VPN Client
VPN Server
Bridge
Primary VPN Server
VM-Container VPN Clients
VPN Junction
Agenda  


Introduc+on  


Design  &  Implementa+on  


Benchmarking  Results  
Cloud  Testbed  
Site B (Rocks 6.0)
Site A (Rocks 6.0)
VM-Container-0-0
OpenNebula (CentOS 6.2)
Frontend
Frontend
VM-Container-0-1
VM-Container-0-1
VM-Container-0-0
Private Network
Public Network
Private Network
Overlay Network
Network  Benchmarking  


Average  Bandwidth:  measured  with  
Iperf
 


Physical  Network:  
776.62  
Mbits
/s  


Overlay  Network:  
314.26  
Mbits
/s  


Round-­‐Trip-­‐Time:  measured  with  ping  


Physical  Network:  
0.135  
ms
 


Overlay  Network:  
0.455  
ms
 
Virtual  Cluster  
Testset
 
Site B
Site A
VM-Container-0-0
VM-Container-0-1
VM-Container-0-0
VM-Container-0-1
Multi-site Virtual Cluster
Single-site Virtual Cluster
Single-host VC
Frontend
Compute-0-0
Compute-0-2
Compute-0-1
Frontend
Frontend
Compute-0-0
Compute-0-2
Compute-0-1
Compute-0-1
Compute-0-2
Compute-0-0
Single-site Virtual Cluster with Physical Network
Compute-0-0
Compute-0-2
Compute-0-1
Frontend
HPCC  Benchmarking  Results  
DGEMM  (CPU  Intensive)  
4.197254  
9.045199  
9.100802  
9.303938  
0  
1  
2  
3  
4  
5  
6  
7  
8  
9  
10  
Single-­‐host  
Single-­‐site  
Single-­‐site  with  
Physical  Network  
Mul+-­‐site  
Average  Gflops  
DGEMM  (CPU  Intensive)  
STREAM  (Memory  Bandwidth)  
20.318253  
18.605038  
18.669311  
21.183269  
20.153016  
19.260255  
18.415776  
21.509165  
19.75952  
18.560227  
17.819891  
21.116839  
18.470081  
17.8158  
17.472441  
19.738259  
0  
5  
10  
15  
20  
25  
Single-­‐host  
Single-­‐site  
Single-­‐site  with  
Physical  Network  
Mul+-­‐site  
Average  GB/s  
Copy  
Scale  
Add  
Triad  
HPL  (Peak  Performance)  
0.3126  
0.5229  
1.873  
0.4117  
0  
0.2  
0.4  
0.6  
0.8  
1  
1.2  
1.4  
1.6  
1.8  
2  
Single-­‐host  
Single-­‐site  
Single-­‐site  with  
Physical  Network  
Mul+-­‐site  
Gflops
 
Conclusion  


The  virtual  cluster  cloud  works  as  expected  


This  cloud  is  suitable  for  
non-­‐network-­‐
intensive  applica1on  


Bio-­‐Chemical-­‐Related  Research  


Video  Rendering  


Brute-­‐force  Searches  


Bitcoin
 Mining  :D  
Future  Works  


BeMer  
Overlay  Network
 implementa+on  


Sogware-­‐defined  Networking  (SDN)  


Intelligence  VM  placement  mechanism  
(scheduling)  


Swarm  algorithm  
Q&A

Thank  you  for  you  aMen+on

Virtual  Cluster  Template

Architecture  (Overview)

Architecture  (Detail)