Recent Efforts on the Asia-Pacific Grid (ApGrid)

brainystitchAI and Robotics

Nov 14, 2013 (3 years and 8 months ago)

55 views

Recent Efforts on the Asia
-
Pacific Grid

(ApGrid)

SEKIGUCHI, Satoshi


Electrotechnical Laboratory (ETL),

AIST(TACC), MITI

Sekiguchi@etl.go.jp

Satoshi Matsuoka

Tokyo Inst. Technology/JST

Matsu@is.titech.ac.jp


Several slides are courtesy of Grid people

What is ApGrid?


A meeting point for
all

Asia
-
Pacific HPCN
researchers

..doing grid
-
related work


Communication channel to the Global Grid
Forum, and other grid communities


Pool for finding international project
partners


Not

a single source funded

project

!


Unlike EuroGrid, eGrid, IPG, etc.

APAN:
http://apan.net



Europe




Exchange Point


Access Point


Current Status


Planned

South Korea

Japan

China

Hong Kong

Malaysia

Singapore

Indonesia







Australia

Philippines

TransPAC

(100 Mbps)



North America

(STARTAP)

Latin America

Europe

Australia
-
Japan Link

(1.5Mbps Frame Relay)

Thailand

ACSys

APAN Projects


Distributed computing


ACSys, ANU, CSIRO, Osaka U, NUS, ISI, Argonne Lab, Indiana U,...


Digital libraries


GEMINI project: ACSys, SingaREN, I2
-
DSI, KAIST, MAFFRC


Earth Observation: CSIRO, Agencies (NASDA, ESA, NASA….)


Data mining


ACSys; Illinois University (Terabyte challenge)


Virtual environments / Telerobotics


ACSys, ETL/RWCP, U Chicago, Indiana


Distance education


Association of Pacific
-
Rim Research Universities (APRU)


Internet technologies


testbeds for MBONE, IPv6, Cache, RSVP/DS/QoS

ACSys

National Backbones for Japaese
Academia

nGrid/eGrid
Partners

TACC: Tsukuba Advanced Computing Center

Osaka: Osaka University

RWCP: Real World Computing Partnership

TIT: Tokyo Institute of Technology

Waseda: Waseda University

APAN

Tokyo

RWCP

TIT

Waseda

Osaka

TransPAC

155Mbps

vBNS

TACC

STAR TAP

Chicago

IMnet

WIDE

SINET

10Mbps

10Mbps

100Mbps

135Mbps

100Mbps

155Mbps

Australia

1.5Mbps Frame Relay

384Kbps

1.5Mbps

135Mbps

(ループ長

約27㎞)

1000km

5km

KEK

AIST/ETL

Tsukuba U

Tokyo

Today 135Mbps

Planned 2.4Gbps

KEK
-
ETL collaboration

CERN (dedicated

2Mbps?)

StarTAP (100Mbps)

ApGRID: motivations (1)


Establish a regional wide testbed for
global computing (Grid and/or Meta)


Disseminating research activities


Providing an easy
-
access environment for
researchers, students, vendors, etc.


Improving interoperability of existing tools


Testbed for software development and trial
to have evaluation of usability and to
archive performance numbers


Finding demonstrative applications

ApGRID: motivations (2)


Create a competitive/collaborative community
to the iGRID and the eGRID for:


Making international collaborations


Supporting and collaborating with network people,
ex. APAN, IM
-
net, etc.


Attempt to negotiate for standardization with real
experience (in Global Gridforum.)


Also, domestic (intra
-
country) service


Nation
-
wide


Several “non
-
cooperative” network communities



Seeking governmental and/or industrial funding


Campus
-
wide


Find Volunteers within our friends

APGrid Locations/Potential Partners


Japan


AIST/TACC/ETL


National Institute of Advanced
Industrial Science and Technology


Tokyo Institute of Technology


Waseda U,


Osaka
-
u,


Nara Advanced Institute of S & T


KEK (DataGrid)


Australia


ANU, Monash U


United States


PNNL, SDSC


Korea (KORDIC, )


Singapore (NUS)


Malaysia


Thailand


ROC,


Hong Kong,


Taiwan


Other APAN members

ApGrid: Services (1)


Grid computing service


Deploy major grid software packages ready
to use


Ninf v.2.0


Globus, Netsolve, NWS, Nimrod, Condor
Legion,etc.


MPICH/G(2), PACX
-
MPI, Harness, etc


System resources


US220R x 2CPU x 4 from ETL


ORIGIN 2000/16CPU, J90/16CPU, CS6400/64


SR8000/8node, WH
-
II 8node


Clusters (Pentium, Alpha), etc in many places

Internet


Ninf Overview

Meta

Server

Meta

Server

Meta

Server

Ninf

Computational

Server

Ninf Library

(Ninf Executable)

Ninf Client Library

:

Ninf_call(“linpack”, ..);

:

Ninf DB

Server

Program

Other Global Computing Systems,

e.g., NetSolve via Adapters

request

results

query

data

Ninf RPC protocol

Ninf Client

Ninf Library

(Ninf Executable)

Ninf Library

(Ninf Executable)

Ninf Overview (cont’d.)


Ninf server + Ninf RPC protocol


transparent execution of Ninf library program on
computational server


Ninf database server


direct query on accurate constant database


Ninf Client Interface


easy
-
to
-
use programming interface


Ninf Metaserver


scheduling of computation, asynchronous and
automatic parallel computation,

Ninf RPC Protocol


Exchange interface information at run
-
time


No need to generate client stub routines (cf. SunRPC)


No need to modify a client program when server’s libraries
are updated.

Client Program

Ninf Server

Stub Program

Client Library

Interface Request

Ninf library program

Interface Info.

Interface Info

Interface Info

Interface Info

Argument

Result

ASP
-
Like ApGrid Ninf Service


Simplified
architecture than
the Ninf Metaserver


Limit the # of known
Servers


Load balancing with
L4 switch technology


Central
administration of
servers and DB


Transaction support




Resource access and
Load balancing w/VIP


Different VIP per
package


e.g. linpack.apgrid.org


Grouping of libraries
via VIP


VIP expands the URL
to address of
appropriate server


Ninf 2.0/Netsolve
etc


(“
lapack
”,”
dgesv
”, .., ..)

lapack.ApGrid.org

murata.ApGrid.org

lapack.eGrid.org

3
-
DNS

hpcc.gr.jp 192.50.75.0/24

ninf.org 150.29.218.0/23

150.29.219.128(VIP)

BIG/IP

Selector/scheduler

BIG/IP

Selector/scheduler

Different VIP per package


e.g.
linpack.apgrid.org

Grouping of libraries via VIP

VIP expands the URL to address of appropriate server

Ninf 2.0/netsolve etc

Simplified architecture than the Metaserver


Limit the # of Servers


Load balancing with L4 switch technology


Central administration of servers and DB


Transactions

Res DB

package

routine

ApGrid: Services (2)


Grid information service


Maintain name servers and databases


ASP
-
like portal service


Handling users, micro economics


Grid security support service (Plan)


PKI: Public Key Infrastructure


Certificate Authority

ApGrid Application examples


Remote/Tele
-
operation


Lifescience/Bioinformatics


High Energy Physics domain (data grid)


SDP


Climate and environmental studies


Fundamental material characteristics


Remote collaboration


etc

ApGrid: Current Status


Just kicked off, and some of the resources
are ready, but still we need:


Hiring people to maintain and to install the regular
services initially


Considering to have meeting in mid. March, 2001


Contributing to the GGF


Enrolling more partners


Reserved: apgrid.org, Web site will be open shortly


Find international partners


Creating much stronger relation with APAN
activities

Summary


Some success stories


Collaboration with Application Scientists


International Collaborations


Osaka
-
U/UCSD (Globus)


NetSolve/Ninf Collaboration


WGCC2000, Grid Forum, metacomputing WS


Government funded several projects


the Asia
-
Pacific Grid (ApGrid)


TACC is ready for providing computing resources


National, Regional testbed


International Collaborations Efforts a MUST!