Recent Efforts on the Asia-Pacific Grid (ApGrid)

Recent Efforts on the Asia
-
Pacific Grid

(ApGrid)

SEKIGUCHI, Satoshi


Electrotechnical Laboratory (ETL),

AIST(TACC), MITI

Sekiguchi@etl.go.jp

Satoshi Matsuoka

Tokyo Inst. Technology/JST

Matsu@is.titech.ac.jp


Several slides are courtesy of Grid people

What is ApGrid?


A meeting point for
all

Asia
-
Pacific HPCN
researchers

..doing grid
-
related work


Communication channel to the Global Grid
Forum, and other grid communities


Pool for finding international project
partners


Not

a single source funded
“
project
”
!


Unlike EuroGrid, eGrid, IPG, etc.

APAN:
http://apan.net



Europe




Exchange Point


Access Point


Current Status


Planned

South Korea

Japan

China

Hong Kong

Malaysia

Singapore

Indonesia







Australia

Philippines

TransPAC

(100 Mbps)



North America

(STARTAP)

Latin America

Europe

Australia
-
Japan Link

(1.5Mbps Frame Relay)

Thailand

ACSys

APAN Projects


Distributed computing


ACSys, ANU, CSIRO, Osaka U, NUS, ISI, Argonne Lab, Indiana U,...


Digital libraries


GEMINI project: ACSys, SingaREN, I2
-
DSI, KAIST, MAFFRC


Earth Observation: CSIRO, Agencies (NASDA, ESA, NASA….)


Data mining


ACSys; Illinois University (Terabyte challenge)


Virtual environments / Telerobotics


ACSys, ETL/RWCP, U Chicago, Indiana


Distance education


Association of Pacific
-
Rim Research Universities (APRU)


Internet technologies


testbeds for MBONE, IPv6, Cache, RSVP/DS/QoS

ACSys

National Backbones for Japaese
Academia

nGrid/eGrid
Partners

TACC: Tsukuba Advanced Computing Center

Osaka: Osaka University

RWCP: Real World Computing Partnership

TIT: Tokyo Institute of Technology

Waseda: Waseda University

APAN

Tokyo

RWCP

TIT

Waseda

Osaka

TransPAC

155Mbps

vBNS

TACC

STAR TAP

Chicago

IMnet

WIDE

SINET

10Mbps

10Mbps

100Mbps

135Mbps

100Mbps

155Mbps

Australia

1.5Mbps Frame Relay

384Kbps

1.5Mbps

135Mbps

（ループ長

約２７㎞）

1000km

5km

KEK

AIST/ETL

Tsukuba U

Tokyo

Today 135Mbps

Planned 2.4Gbps

KEK
-
ETL collaboration

CERN (dedicated

2Mbps?)

StarTAP (100Mbps)

ApGRID: motivations (1)


Establish a regional wide testbed for
global computing (Grid and/or Meta)


Disseminating research activities


Providing an easy
-
access environment for
researchers, students, vendors, etc.


Improving interoperability of existing tools


Testbed for software development and trial
to have evaluation of usability and to
archive performance numbers


Finding demonstrative applications

ApGRID: motivations (2)


Create a competitive/collaborative community
to the iGRID and the eGRID for:


Making international collaborations


Supporting and collaborating with network people,
ex. APAN, IM
-
net, etc.


Attempt to negotiate for standardization with real
experience (in Global Gridforum.)


Also, domestic (intra
-
country) service


Nation
-
wide


Several “non
-
cooperative” network communities



Seeking governmental and/or industrial funding


Campus
-
wide


Find Volunteers within our friends

APGrid Locations/Potential Partners


Japan


AIST/TACC/ETL


National Institute of Advanced
Industrial Science and Technology


Tokyo Institute of Technology


Waseda U,


Osaka
-
u,


Nara Advanced Institute of S & T


KEK (DataGrid)


Australia


ANU, Monash U


United States


PNNL, SDSC


Korea (KORDIC, )


Singapore (NUS)


Malaysia


Thailand


ROC,


Hong Kong,


Taiwan


Other APAN members

ApGrid: Services (1)


Grid computing service


Deploy major grid software packages ready
to use


Ninf v.2.0


Globus, Netsolve, NWS, Nimrod, Condor
Legion,etc.


MPICH/G(2), PACX
-
MPI, Harness, etc


System resources


US220R x 2CPU x 4 from ETL


ORIGIN 2000/16CPU, J90/16CPU, CS6400/64


SR8000/8node, WH
-
II 8node


Clusters (Pentium, Alpha), etc in many places

Internet


Ninf Overview

Meta

Server

Meta

Server

Meta

Server

Ninf

Computational

Server

Ninf Library

(Ninf Executable)

Ninf Client Library

:

Ninf_call(“linpack”, ..);

:

Ninf DB

Server

Program

Other Global Computing Systems,

e.g., NetSolve via Adapters

request

results

query

data

Ninf RPC protocol

Ninf Client

Ninf Library

(Ninf Executable)

Ninf Library

(Ninf Executable)

Ninf Overview (cont’d.)


Ninf server + Ninf RPC protocol


transparent execution of Ninf library program on
computational server


Ninf database server


direct query on accurate constant database


Ninf Client Interface


easy
-
to
-
use programming interface


Ninf Metaserver


scheduling of computation, asynchronous and
automatic parallel computation,

Ninf RPC Protocol


Exchange interface information at run
-
time


No need to generate client stub routines (cf. SunRPC)


No need to modify a client program when server’s libraries
are updated.

Client Program

Ninf Server

Stub Program

Client Library

Interface Request

Ninf library program

Interface Info.

Interface Info

Interface Info

Interface Info

Argument

Result

ASP
-
Like ApGrid Ninf Service


Simplified
architecture than
the Ninf Metaserver


Limit the # of known
Servers


Load balancing with
L4 switch technology


Central
administration of
servers and DB


Transaction support




Resource access and
Load balancing w/VIP


Different VIP per
package


e.g. linpack.apgrid.org


Grouping of libraries
via VIP


VIP expands the URL
to address of
appropriate server


Ninf 2.0/Netsolve
etc


(“
lapack
”,”
dgesv
”, .., ..)

lapack.ApGrid.org

murata.ApGrid.org

lapack.eGrid.org

3
-
DNS

hpcc.gr.jp 192.50.75.0/24

ninf.org 150.29.218.0/23

150.29.219.128(VIP)

BIG/IP

Selector/scheduler

BIG/IP

Selector/scheduler

Different VIP per package


e.g.
linpack.apgrid.org

Grouping of libraries via VIP

VIP expands the URL to address of appropriate server

Ninf 2.0/netsolve etc

Simplified architecture than the Metaserver

・
Limit the # of Servers

・
Load balancing with L4 switch technology

・
Central administration of servers and DB

・
Transactions

Res DB

package

routine

ApGrid: Services (2)


Grid information service


Maintain name servers and databases


ASP
-
like portal service


Handling users, micro economics


Grid security support service (Plan)


PKI: Public Key Infrastructure


Certificate Authority

ApGrid Application examples


Remote/Tele
-
operation


Lifescience/Bioinformatics


High Energy Physics domain (data grid)


SDP


Climate and environmental studies


Fundamental material characteristics


Remote collaboration


etc

ApGrid: Current Status


Just kicked off, and some of the resources
are ready, but still we need:


Hiring people to maintain and to install the regular
services initially


Considering to have meeting in mid. March, 2001


Contributing to the GGF


Enrolling more partners


Reserved: apgrid.org, Web site will be open shortly


Find international partners


Creating much stronger relation with APAN
activities

Summary


Some success stories


Collaboration with Application Scientists


International Collaborations


Osaka
-
U/UCSD (Globus)


NetSolve/Ninf Collaboration


WGCC2000, Grid Forum, metacomputing WS


Government funded several projects


the Asia
-
Pacific Grid (ApGrid)


TACC is ready for providing computing resources


National, Regional testbed


International Collaborations Efforts a MUST!