Federated Virualized Infrastructures & Future INTERNET ... - netmode

uptightexampleNetworking and Communications

Oct 24, 2013 (3 years and 10 months ago)

100 views

F
EDERATED
V
IRTUALIZED
I
NFRASTRUCTURES

AND
F
UTURE
I
NTERNET
R
ESEARCH:

The NOVI Experience

Vasilis

Maglaris

Professor of Electrical & Computer Engineering, NTUA


Chairman, NREN Policy Committee
-

GÉANT Consortium

maglaris@netmode.ntua.gr


NETCLOUD Workshop

IEEE
CloudCom

2011


November 30
th

201
1, Athens, Greece





A FIRE Research Project:
NOVI

N
etworking innovations

O
ver

V
irtualized
I
nfrastructures

2



EC FP7


Cooperation


(DG INFSO
-
F, FIRE Unit)




13 Partners (NRENs,


Academic & Research


Institutions, Industry)



30 Months (starts Sept.
2010)


The NOVI Consortium

1.


National Technical University of Athens
-

NTUA

(Coordinator,
Greece
)

2.


Martel

GmBH

(
Switzerland
)

3.


Université Pierre & Marie Curie
-

UPMC

(
France
)

4.


Consortium
GARR

(
Italy
)

5.


Universiteit van Amsterdam
-

UvA

(
Netherlands
)

6.


Fundació
i2CAT

(
Spain
)

7.


DFN

Verein (
Germany
)

+ Universität
Erlangen

-

Nürnberg

8.


Institut National de Recherche en Automatique et Informatique
-

INRIA

(
France
)

9.


Eötvös Loránd Tudományegyetem
-

ELTE

(
Hungary
)

10.


Poznan Supercomputing and Networking Center
-

PSNC

(
Poland
)

11.
Cisco

Systems International B. V. (
Netherlands
)

12.
Fraunhofer

Gesellschaft zur Förderung der angewandten Forschung (
Germany
)

13.
Universitat Politècnica de Catalunya


UPC
(
Spain
)




3

NOVI’s Mission within the Future
Internet (FI) Ecosystem


FI emerges as a complex ecosystem, offering holistic services to
users over
shared federated interconnected platforms
.



NOVI targets innovative research in a bottom
-
up approach,
addressing a critical area in FI services:
How FI users
(including Data Center Managers & Cloud Service
Providers) securely share a multi
-
domain networking
substrate.




NOVI aspires to develop a framework (information model, test
tools and algorithms) that will empower FI users to discover,
view, monitor, control and provision isolated/virtualized
networking resources within a federated networking substrate,
thus
complementing their distributed storage & computing
service baskets with interconnection
-
specific resources.


4

NOVI Research Goals


How to
federate

different kinds of resources in virtualized e
-
Infrastructures


How to
formally describe

virtualized network and cloud objects in a
complex environment, assisted by semantic methods. What
ontologies

are best suited to describe resources of different kinds


How to build
combined slices

of virtualized infrastructure at the data,
control, monitoring and provisioning planes. How to describe their
relationships and technical attributes


How to (co
-
) allocate resources with
QoS

attributes and how to set up
the monitoring system to allow for accountable, predictable FI
services;
multi
-
domain

virtual network embedding


How to enrich FI experimental platforms (
PaaS
) with federated models
and methods enabling
comprehensive and reproducible experiments


5

The NOVI Information Model Background

6

Various efforts
form the basis of
the NOVI
Information and
Data Models

NOVI Control & Management (C&M)
Architecture


Spiral 1

7

AM

CM

SM

AM

FEDERICA WS

SM

PlanetLab

FEDERICA

(
MyPLC
)

NOVI C&M

Communication

Reg

Reg

SM
: Slice Manager

AM
: Aggregate Manager

CM
: Component Manager

Reg
: Registry


SFA calls

FED calls

Innovative C&M Services

Building on Slice Federation Architecture
-

SFA


Intelligent Resource Mapping Service
to embed user requests for virtual
network overlays (slices) within the physical substrate.



Discovery Service
able to efficiently discover resources (slivers) based on
their context.



Resource Allocation Service

to instruct Platform Slice/Aggregate
Managers to commit



Monitoring Service
to assess behavior of resources depending on roles.



Policy Management Service
that governs the intra and the inter domain
behavior of the NOVI federation, including role
-
based user access control.



Database Service
with entities defined within NOVI Information Model
including their semantic attributes.



Request Handler Service
for service & virtual resource requests.


8

NOVI Federated Slice Creation
Generic Steps

1.
A
user
registered in
Platform_A

requests a combined
slice with slivers (virtual resources) in
Platform_A
,
Platform_B
….
via the NOVI
Portal/API

2.
The NOVI
Resource Discovery Service

checks availability
of slivers from
Platform_A
,
Platform_B
….

3.
NOVI’s
Intelligent Resource Mapping Service

suggests
intelligent multi
-
domain composition of
user
slice

4.
NOVI’s
Resource Allocation Service

instructs

Platform_A
,
Platform_B


to commit slivers to
user
consistent with their
local policies

9

Federated Data Plane Connectivity

NOVI Virtual Switch (
NSwitch
)


Spiral 1

10

NOVI’s Positioning in European &

Global FI Research


NOVI’s research is aligned with mainstream research efforts in
Europe (
EC FIRE

Initiative), the US (
NSF GENI

Initiative), Asia
Pacific (
NICT


Japan,
CERNET

-

China,
KOREN

Korea,
NICTA

-

Australia...)




NOVI partners combine expertise from


Advanced networking platforms (
GÉANT
,
NRENs
,
GLIF
…)


FI experimental facilities (
FEDERICA
,
PlanetLab

Europe…)


Advanced industrial solutions in virtualized environments (Cisco
Nexus
1000V
)


ICT/FI RTD projects (
Phosphorus
,
Manticore
,
OneLab
,
Panlab
,
GEYSERS
,
BonFire
,
G
-
Lab
…)


FI coordination actions (
FIRESTATION,
FIREworks
,
INFINITY

-

FI PPP…)



NOVI interacts with standardization bodies and disseminates its
findings in scientific events and global FI initiatives; it assists on
developing the FIRE facility at the
FIRE Architecture Board


11

Sustainability of FI Experimental Research


A concern in the times of crisis but FI Research is a
high
-
risk
strategic investment



Advanced Internet
-
based e
-
Infrastructures perceived as
creative commons

and a

stimulus to recovery:

Obama’s
initiative & EU FI PPP…


Some problem areas:


Subsidiarity

between Federal (EC) & National policies


Selection of Projects based on periodic peer reviews (spirals),

old
boys networks



Synergies

with major vendors (Cisco, Juniper, NEC, HP…) and Cloud
SPs (IBM, Google, SAP...);
IPRs & openness



Emphasis on attracting
end
-
users
:

EU Living Labs & FIRE Integrated
Projects Open Calls (up to 250 K Euros/year per “user”)


8

Sustainability Factors

(1/2)


Sustainability depends on active endorsement of
diverse user
communities

(beyond ICT researchers)


Users

need to understand (and appreciate) the benefits and
economic incentives in using multifaceted FI experimental
platforms


Priorities, requirements and budgetary constraints of users
need to guide
planners/providers

of FI experimental
platforms (e.g. user
-
friendly open interfaces, policies for
reproducibility of experiments)




9

Sustainability Factors (2/2)


FI experimental platforms should attract users by developing


deploying user friendly tools, based on
efficient resource
allocation algorithms

(e.g. Virtual Network Embedding),
monitoring schemes

(slice and substrate oriented) and
novel
information models

(e.g.
ontologies

assisting users to locate
and compose virtualized resources in a distributed FI
environment)


Operational costs

should be assured, required for seamless
infrastructure support (and hardware


software upgrades)


Well defined
SLAs

and broadly acceptable
pricing models

are
required, in line with legacy Service Provider practices


14


Federation
is tightly related with
Sustainability



The FI will be a shared multi
-
domain ecosystem where:


Users should be able to run their applications/experiments by
dynamically
selecting diverse slivers

within a slice (basket) of the
federated FI facility


Federated FI facilities should be able to upgrade their scope by
incorporating additional
testbeds
, thus attracting a wider user
base: Need for
open, scalable federation architectures

(bases:
PlanetLab

SFA
,
Panlab

Teagle
)


Exploit synergies with established advanced
R&E e
-
Infrastructures

should be exploited:



In the US
Internet2
,
NLR

are used as backbone facilities for GENI
infrastructures


e.g.
OpenFlow

testbeds
, VINI…


In Europe,
NRENs
-

GÉANT

can provide support for advanced
connectivity services amongst European virtualized infrastructures


In Asia
-
Pacific advanced R&E networks provide virtualized platforms,
interconnecting FI
testbeds


Plan towards a
global federated environment for FI experiments


1
1

Potential role of GÉANT


NRENs

in the FI Ecosystem


Provision FI federated platforms
(FIRE, FI PPP) with WAN substrate Gigabit+
connectivity at all protocol layers/planes (including
Bandwidth on Demand
)
& core virtual facilities (systems, logical routers, virtualized data centers…)


Support virtual resource allocation, scheduling, federated admission
control, roaming AAI & secure operation of isolated communities,
instantiating the concept of
Infrastructure as a Service (
IaaS
)


Deploy and test early prototype tools to create, monitor and control virtual
resources allocated to FI user communities, towards the
Network on
Demand

vision


Complement efforts towards common, context aware descriptions of
heterogeneous virtual networking elements, enabling
resource discovery &
provisioning

of composite services to meet user demands


Export
NOC functionality

to virtual communities to enable scalable
management of virtual resources by stake
-
holders of federated overlays


16

Virtualization over GÉANT
-

NRENs



17

Future Internet Experimental Research:

An Opportunity for NRENs


Requirements:



Sharing optical backbones & housing for FI experiments


Emulating real
-
world conditions


In isolation from production traffic (slicing, virtualization)


Interconnection of local
testbeds

(e.g.
OpenFlow
, wireless labs)


NRENs as infrastructure providers & innovation brokers:


In
Europe
: FI Private
-
Pubic Partnership (PPP) & FIRE


provisioning of NREN


GÉANT facilities (e.g. FEDERICA)


In the
US
: GENI experimental platforms


provisioning of
Internet
2
, NLR,
ESnet
, RON facilities (e.g. VINI)


In
APAN
: SINET (JP), CERNET (CN), KOREN (KR),
AARNet

(AU),…


18

The GÉANT Service Area

19

GÉANT COST:

40 M

/
year (equally shared
by EC and NRENs)


Not
just the GÉANT
backbone


Federated
services via
37
NRENs

and

4000
+ Campuses

to
5
0
M+
users

Total European R&E Networking Cost:

International (GÉANT) / National (NREN) /
Campus

Costs
follow the

1/10/100
rule




GÉANT global connectivity


GÉANT2 global
connectivity


February 2009


AfricaConnect

Key Challenge for

NRENs
-

GÉANT:

A Tsunami of Global High
-
End Requirements

21

10 Gig+ NREN


GÉANT Footprint, June 2009

High
-
End Users (HPC, CERN, ITER,…) require stable production

services:


Provisioning
10
-
40
-
100
Gbps

networks (DWDM over dark fiber, leased
λ)



Meeting
robustness, reliability, security requirements


Enabling
multi
-
domain e2e monitoring & on
-
demand hybrid resource allocation


Managing
converging e
-
infrastructures as a High Performance Computing &

Networking

(HPCN) Cloud


Future Internet (FI) Services & Applications

Related Public Web Pages



http://ec.europa.eu/information_society/activities/foi/index_en.htm

(link to
EU Future Internet

activities)


http://cordis.europa.eu/fp7/ict/fire/
(link to
EU Future Internet
Research & Experimentation

activities)


http://www.fp7
-
novi.eu/

(link to
NOVI

site)


http://www.geant.net/pages/home.aspx

(link to
GÉANT

site)


http://www.netmode.ntua.gr

(link to
netmode.ntua.gr

laboratory)


22