Current Status and Future Directions for NEES Cyberinfrastructure

cowphysicistInternet and Web Development

Dec 4, 2013 (3 years and 8 months ago)

59 views

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES 4
th

Annual Meeting

Washington D.C., June 21
-
23, 2006

Anke Kamrath (
kamratha@sdsc.edu
)

Lelli Van Den Einde (
lellivde@sdsc.edu
)

Shannon Whitmore (
swhitmor@sdsc.edu
)

Ahmed Elgamal (
elgamal@ucsd.edu
)


http://it.nees.org


Current Status and Future Directions
for NEES Cyberinfrastructure

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Overview


Overview of the Year for NEESit (
Anke Kamrath
)


NEES Cyberinfrastructure: Vision, Priorities, and People


Accomplishments during FY06


NEESit @ Annual Meeting


Demonstration of Data and Telepresence Capabilities
(
Lelli Van Den Einde & Shannon Whitmore
)


Background: Use Case Groups


Case Study: Pre
-
NEESR Soil
-
Foundation
-
Structure
-
Interaction Project


NEES End to End Workflow


NEES Data Model


NEEScentral Overview


Telepresence Overview


Roadmap for Remainder of FY06


Future Directions for NEES Cyberinfrastructure (
Ahmed Elgamal
)

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Overview of the Year for NEESit



Anke Kamrath

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Cyberinfrastructure


Vision and Priorities


NEES CI Vision


Drive the cutting
-
edge of fundamental and
transformative research in earthquake
engineering through the application of
information technology


Broaden impact of research to researchers,
practice and education through IT.


Information Technology Priorities


Robust remote participation environment


World class data repository


Collaboratory to enable integration of wide
-
ranging tools and applications (through web
services) to facilitate new paradigms of
usage, collaboration, and discovery

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Cyberinfrastructure
-

People Make it Happen

NEESinc BOARD

OF DIRECTORS

IT Strategy

Committee

NEESinc HQ

Executive Director

Chief IT Officer

Data Librarian

Web Master

NEES Cyberinfrastructure

Center:

SDSC & partners

Equipment Sites

1
-
2 IT Personnel

per site

Data Development

Infrastructure &

Outreach

Telepresence,

Collaboration and QA

Software Architect

SW Development

Production IT Support
Security Officer

+ Contractor

+ Contractor

SubKs

SubK

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Cyberinfrastructure

Simulation:


HPC allocations,

large
-
scale data analysis,
simulation, and modeling

Community Databases

& Data Collections:


Data management, sharing,
queries, mining and
preservation


Software:

Web Services, Tools,
Applications, and
Community Codes

Education:

Earthquake Engineering
education and training

Outreach
:

Collaboration and
community leadership with
other large
-
scale projects

RDV

REU

EDcentral

flexTPS

People:

NEES consortium,
researchers, equipment
sites, practitioners, NEESit

Inf
rastructure &


Middleware:


DAQ Systems, Networks,
Storage, Servers,
Security,

Middleware

NEES

Cyberinfrastructure

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

FY06 Highlights


NEEScentral: Growing data system with
active data management


Significant NEEScentral Usage


>450 Accounts, >40 Research Projects


https://central.nees.org



Database backend with growing metadata model and
user interfaces (Currently >100 fields)


In
-
depth overview later in this session


Collaboration and Outreach Tools:


WebEx (
https://nees.webex.com
) deployed Oct 2005


Quickly adopted as key planning tool for NEESR teams


NEES Site Activities (NAWI) deployed Nov 2005


https://central.nees.org/activities



Watch what’s happening at all the equipment sites!


Videoconferencing via Internet2 deployed May 2006

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation


High
-
end Computing


200K Allocation received for SDSC DataStar and

Teragrid resources Oct 2005


Active Usage from 12 research groups


Largest run using 2048 processors



OpenSees w/ custom domain objects and 25M elements


Available to NEES community
http://it.nees.org/support/supercomputing/index.php



Telepresence Enhancements:


Expansion of tabular panel (spreadsheet style display of
sensors)


Load/save a configuration


Pan/Tilt/Zoom support for video


In
-
depth overview later in this session


Automated Build and Test Environment


Deployed Jan 2006


Support high
-
quality, iterative development process

More Highlights

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Highlights: Technology Outreach


Community Code Repository (NEESforge)


http://neesforge.nees.org

(deployed Dec 2005)


25 Hosted Projects and 41 Registered Users


Environment for researchers to manage code on their own


Bug / feature tracking and discuss forum / mailing list


Version control system and documentation


Download


All open source


Pipeline for bringing community development efforts into
NEES CI


NEESit User Support Services


Guaranteed one business day response


Toll free #: 866
-
260
-
4100,


Email:
it
-
support@nees.org



Web:
http://it.nees.org/support
,
https://central.nees.org/help



All issues logged in Fogbugz tracking systems

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

More Outreach Highlights


Strong International Partnerships


E
-
Defense (Japan), SAMCO (EU), KOCED
(Korea), NCREE (Taiwan), and others


All groups interested in standardized data
models for sharing data across distributed
data repositories


Strong Interest in sharing software solutions
and joint development efforts


EDcentral already deployed!


EU leveraging NEES DataTurbine and
Telepresence solutions


Strategy: Let’s not compete over the CI


rather focus competition in research arena

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEESit @ Annual Meeting


Booth:


8:00am
-
5:00pm, Wednesday and Thursday.



No booth on Friday.


Demos:

NEEScentral and RDV (punching bag)



"Meet a NEESit Expert“


Sign up sheet at the booth to schedule 10
-
15 minute meetings with
Lelli, Shannon, Wei



Training Workshop:


Friday 1pm
-
5:15pm


Accepting reservations until COB Weds (Today). Stop by booth or
register on
-
line at
http://it.nees.org/support/workshops/workshop_enduser.php



Overview of NEESit Software & Services, Organize and Manage Data,
Participate in a Remote Experiment, Collaborate in a Distributed
Project, Simulation and Hybrid Simulation

For more info about NEESit see
http://it.nees.org


NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Demonstration of Data and
Telepresence Capabilities



Lelli Van Den Einde & Shannon Whitmore

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Background


Use Case Groups


Data: SFSI pre
-
NEESR project


Sharon Wood, Bruce Kutter, Dan Wilson, Adolfo Matamoros, Mahadevan
Ilankatharan (Lanka)


Coordinated research project to study soil
-
foundation
-
structure interaction


Test different components of a two
-
span bridge assemblage at different scales
with different boundary conditions


Project utilizes 3 NEES Equipment Sites (Centrifuge, Shake Table, and Field),
Purdue Structural Tests, and UW and UC Berkeley Simulation


Focus for June release: UC Davis Data Report


Telepresence


Sri Sritharan, Laura Lowes, Jerry Hajjar


UMN
-
MAST pre
-
NEESR T
-
Wall test


WebEx meetings with each group every 2 weeks


Feedback informs development

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Computational Models

UW, UCB, & UCD

Prototype Structure

Outreach

SJSU

Data

Kansas

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Prototype Structure

Computational

Models

Centrifuge

Tests

Field

Tests

Shaking Table

Tests

Structural

Tests

Case Study: SFSI Pre
-
NEESR Project

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES End
-
to
-
End Workflow

SDSC/
Teragrid
compute

resources

Internet2

WebEx

Share data, plan,

collaborate

Simulation

OpenSees

Experiment planning & prep

Shake
Table Test

flexTPS

Remote

researchers

On site

researchers

Organize & Structure Data

DAQ

Field Test


SingleShot*

Centrifuge Test

Public viewers

Remote participation in experiment

Data Turbine

NEESdaq

flexTPS

NEES Site Activities

DAQ

RDV

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES Data Model


Goal: Preserve and organize all data necessary to
reproduce experiment


Structured vs. Unstructured data


Driving forces


SFSI Pre
-
NEESR project (emphasis on Centrifuge/UC Davis Data Report)


NEES Reference Data Model by Peng and Law


Geotechnical Data Model by Bardet/Swift/Kutter/Wilson


Tsunami Data Model by NACSE/OrSt


~70% of the model is common across all disciplines


Current data model being passed around now…


NEESit seeking feedback from researchers on this model


What works? What is missing?


Write down comments and return them to NEESit booth or send feedback to
it
-
support@nees.org


NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Page 3 of Handout

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Page 4 of Handout

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Page 5 of Handout

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Page 6 of Handout

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEEScentral Overview


Facility (SSDB migrated to NEEScentral)


Contact Info/Staff/Training and Certification


Equipment


Sensor Inventory and Calibrations


Research


Data IN


Project metadata (Page 8 of Handout)


Experiment metadata (Page 9 of Handout)


Setup: Material Properties (Page 10 of Handout)


Setup: Coordinate Spaces (Page 11 of Handout)


Setup: Sensor Location Plan (Page 12 of Handout)


Setup: Model (Page 12 of Handout)


Setup: Equipment Inventory (Page 13 of Handout)


Setup: Scale Factors (Page 14 of Handout)


Trial metadata


Setup: Channel List (Page 15 of Handout)


Setup: Input Motion (Page 15 of Handout)


Search Data (Page 16 of Handout)


Experiment Report (Starting on Page 18 of Handout)

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Telepresence Overview


Researcher and/or Outreach Tools


NEES Activities Web Interface (NAWI)


Promotes outreach of NEES research


Integrates real
-
time video streams via
flexTPS


https://central.nees.org/activities



flexible TelePresence System (flexTPS)


Real
-
time video from an equipment site


Developed by Christopher Stanton


http://assam.mast.umn.edu/portal



Real
-
Time Data Viewer (RDV)


Real
-
time data viewing during an experiment


Collaborative development effort between
NEESit and University at Buffalo (Jason
Hanley)


http://it.nees.org/software/rdv/index.php




Telepresence Middleware


Data Turbine


NEESdaq


NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Telepresence Kudos


MAST pre
-
NEESR T
-
Wall test


Invited remote researchers to participate in various phases of testing


Industry Partner (Susie Nakaki)


“With guidance from Wei, I found RDV very easy to use, and especially like the
“drag and drop” plots that allowed me to look at information that interested me,
independent of what the research team was viewing. This tool allowed me to
participate over the course of several days, with minimal disruption to my business.”


European Union: ELSA Laboratory, Italy
(Pierre Pegon)


“I am very happy with this version of RDV. I am
now using telepresence for almost every test we
are performing.”


University of Auckland, NZ


From Sri Sritharan: “The Auckland faculty were
impressed” <when they participated in the MAST
test via WebEx, watching Wei's demonstration of
RDV>

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Feedback from Use Case Groups

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Roadmap for Remainder of FY06

Data Management Highlights

NEEScentral 1.6 (August)


Support for field data model


Support for simulation data model


Bulk upload phase I


Sensor location plan


Channel List/DAQ


Significant extension of web services


To enable equipment site specific software
for data ingestion


Advanced reporting capabilities


Generate Data Report in different
formats (PDF, Excel, etc)


Generate spreadsheet from any
table


Print from any web page



NEEScentral 2.0 (October)


Support for shake table data model


Support for tsunami data model


Curate and publish experiment


Improved structured search


More metadata search options


Advanced unstructured search


Search files using Google search engine


Bulk upload phase II


Coordinate Spaces


Others as needed


Bulk download




NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Roadmap for Remainder of FY06

Telepresence/Hybrid Simulation Highlights

DataTurbine 3.4 (July)


Extracted from NEESpop distribution


Repackaged as RPM


Bug fixes to Server and NEES utilities


Significant improvement to
documentation


RDV 2.0 (October)


High Resolution Still Images


Time
-
lapse movies


Extract X frames/second


Integration with NEEScentral


Save experiment data to repository


Replay experiment data from repository

RDV 1.4 (August)


Discontinuous timeline


Filter downtime from display


Replay archived experiment data


Event Annotations


Mark events of interest

Hybrid Simulation


Communications Framework
(September)


Protocol


Library


Server

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Looking For Feedback


Return comments on data model


Contact Us!


it
-
support@nees.org


Toll Free: 866
-
260
-
4100


Submit bugs/feature requests:
http://it.nees.org/support


NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

Future Directions for NEES
Cyberinfrastructure


Ahmed Elgamal