Earth Science needs a tools market place!

motherlamentationInternet και Εφαρμογές Web

7 Δεκ 2013 (πριν από 3 χρόνια και 8 μήνες)

104 εμφανίσεις

Earth Science needs a
tools market place!
Rahul Ramachandran
Michael
McEniry

Manil

Maskey


Information Technology and Systems Center,
University of Alabama Huntsville
rahul.ramachandran@uah.edu


AGU Fall Meeting
San Francisco, 2011
Problem Statement


Science user tools for analyzing Earth science data are
proliferating.


These tools are typically single-purpose and linked in only
limited, ad-hoc ways.


A researcher must often use multiple tools to perform an
analysis, manually transferring information among them.


The tool developers are seeking means to widely
disseminate their specialized algorithm or tool, whereas the
users want general purpose analysis environments such as
Matlab
or IDL, with the option to customize and extend as
needed.
Example – Visualization Tools
VIS5D
PANOPLY
SciPY

R
IDL
NCL
GLIDER
IDV
Ideal World


Pick modular functionality and
customize for my own needs
IDL
GLIDER
IDV
My  Favorite  Tool  
Earth  Science    
Work  Bench  
Scripting
Capability
Mining
Capability
Visualization
Capability
(Re) Use Open Source Frameworks


Use robust open source frameworks as platforms for building
science applications


Adopt, Adapt, Develop


Advantages:


Leverage crowd sourced design and development


Reduce redundancy and shorten project life cycles


Not bound to any one institution/organization to provide the
framework


Disadvantages


Steep learning curve


Lack of documentation


Examples: Eclipse RCP (Desktop), Drupal (Web)
Eclipse Rich Client Platform


Eclipse Integrated Development Environment (IDE) is
designed as a small kernel containing a plug-in loader for
hundreds of plug-ins


Kernel is an implementation of the Open Services Gateway
initiative (
OSGi
) specification that defines dynamic installing,
starting, stopping, updating of new plug-ins.


Design enables modularity, where discrete chunks of
functionality can be reused to build new applications and the
minimal set of plug-ins necessary to create a client
application is called the Eclipse Rich Client Platform (RCP)


Eclipse RCP supports many community-contributed plug-ins,
making it a popular development platform
Benefits of Using Eclipse RCP


Comprehensive component
libraries to build custom
applications.


Middleware and
infrastructure that facilitates
seamless integration of
tools


Native user interface


Portability


Intelligent install and update
of plugins.


Disconnected Operation
where applications can run
standalone without a
network connection


Large Pool of Custom Plug-
ins developed by a large
Eclipse community
Eclipse Based Applications


GumTree
is a workbench for Neutron Science that is being
extended by their communities to build customized
applications.


Wombat, Platypus, Quokka are instrumentation
customizations of
GumTree
.
Eclipse Based Applications


CIShell
is a workbench in Information Science that is being
extended by their communities to build customized
applications.


NWB and Sci2 are example customizations of
CIShell

Prototype Example: Combining IDL and
GLIDER


IDL moved to an
Eclipse based-
workbench
environment in
2008 with their
release version
7.0


GLIDER
integrated with
into IDL
workbench


Combines best
of both tools
COMMON
PROJECT EXPLORER
IDL COMMAND LINE
VISUALIZATION VIA GLIDER
Drupal as an Open Framework


Installs on a fully open-source software stack (
xAMP
)


Separates presentation from content


Provides rich set of rules and roles for managing users and
content publication workflow


Supported by an active code development community
(perhaps the largest such community in the CMS world)
Data Mining Solutions Center
Specialized Development
80%
20%


Online community portal of researchers that apply data
mining techniques in their Earth science research.


Provides access to over one hundred different mining
algorithms exposed as services.


Allows researchers to search, move distributed data, create
and execute mining workflows, share workflows/experiments
and publish science stories backed by data and workflows.
Tools Store?


Someone (funding agencies) needs to foster a marketplace


Provide guidance when funding development i.e., adoption of a (set
of) open source framework(s)


Provide a marketplace or store for developers to connect to
researchers
Analysis  Tool  
[Store]  
Analysis  Tool  
Extensions  
Researchers  
Developers  
Funding  Agency  
Fund
Development
Provide a
Market Place
Submit
Extensions
Download
Extensions
Customize
Tool
Open  Source  
Frameworks  
Leverage
Benefits


Researchers


Easily discover new functionality


Customize ‘their’ workbench with new functionality


Improve productivity and speed up scientific progress


Developers


Focus on modular tool development rather than marketing


Easily reach a broad base of users


Funding Agencies


Avoid funding redundant activity


Track usage of developed tools to evaluate further funding needs
Obstacles


Researchers


If you build it, will they come?


Developers


Hate learning frameworks because it is hard


Easier to build from scratch


Need to overcome “Not Built Here” syndrome


Funding Agencies


Need to identify key technologies (frameworks) within the
application layer of the software stack


“Suggested” open frameworks may not satisfy everyone
Conclusions


Earth Science needs a tools store


Win/Win/Win proposition for all three parties


Expanded to algorithms


The use of open source frameworks as platforms for building
applications is a step in the right direction


Funding agencies need to influence market forces by:


Incentivizing developers to adopt and adapt open source
frameworks


Provide a tools store for developers to connect with researchers
Looking Ahead:
Earth Science
Collaboratory



Marketplace within
ESC will promote
shared tools


Shared tools will
enable construction
of reusable,
shareable workflows


Net result: shared
reusable results and
knowledge