SIXTH Middleware : Toward Autonomic Sensor Networks

hesitantdoubtfulAI and Robotics

Oct 29, 2013 (4 years and 11 days ago)

108 views

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

SIXTH Middleware : Toward
Autonomic Sensor Networks

Professor Gregory O’Hare, Dr Rem Collier &
Dr Micheal O’Grady

Research Proposal to Vodafone

10
th

July 2011

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Research Overview:
Middleware for Sensor Web

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

1960

1970

1980

1990

2000

2010

2020

1M

10M

100M

1Bn

10Bn

100

M

1B
+

10B
-

100B

Mainframe

1M Units

Minicomputer

10M Units

PC

100M Units

Cellphone

1B+ Units

Sensor Devices

10B+ Units

Devices/Users (Log Scale)

Digital

World

Physical

World

100Bn

The Sensor Web

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Middleware for the Sensor Web


Sensor Web:


The aggregation of physical and cyber sensing technologies
within a single unified framework.


Sensor Web Middleware:


The enabling software layer that delivers the core
functionality necessary to realise the Sensor Web.


Core Functionality:


Uniform Data Access Model


Sensor Discovery Mechanisms


Data and Sensor Security


Sensor Management and Configuration

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Existing Solutions


UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Our Approach: Middleware
for Sensor Web

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

SIXTH Overview

SIXTH’s goal is:

“an extensible, scalable, intelligent middleware for the Sensor Web based on OGSi”

SIXTH Philosophy:

SIXTH is targeted at dynamic and adaptive Sensor Web deployments and is focused
on runtime re tasking of sensors and in
-
situ intelligence

SIXTH Components:

Sensor Model:
Properties
-
based model for control of and access to sensing devices.

Adaptors:
Links sensor specific implementations to a standardised interface that can
be accessed via higher
-
level APIs.

APIs:
Core functionality of the SIXTH architecture, covering: data access, re
-
tasking,
notification, security and discovery.

Services:
Data processing layers that build on the APIs.

Intelligence:
Integrated multi
-
agent system to support in
-
situ reasoning and
management.

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

SIXTH Architecture

Adaptors:

Virtual Sensor creation

Sensor
-
SIXTH integration

Discovery Service:

Secure Sensor Access

Receivers:

Streaming of sensor data

Notifiers:

Filtered sensor data streams

Services:

Data processing / Dissemination

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Deployments

Application(s)

Gateway Deployment

In
-
Network Deployment

Cyber Deployment

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

SIXTH Toolkit

Data Visualisation

Sensor Deployment

http://sourceforge.net/projects/sixth/

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

SIXTH Uniqueness


Informed by Emerging Standards


OSGi, OGC Sensor Web Enablement Standards, IEEE 1451 (
PnP standard for device
configuration)


Sensing the Sensor Web

Cyber Sensors
for online data streams (RSS, Twitter, Gowalla, Facebook, …)

Physical Sensors
for heterogeneous sensing devices


Dynamic re
-
tasking of Sensors

Support diverse applications across multiple sensors and WSN subnets


Realizing Intelligent Sensor Networks (iSNs)

Enables collaborative and distributed decision
-
making throughout the WSN.


Interoperable with existing abstractions/programming models

Database Models (TinyDB, GSN), REST, HOOD, Abstract Regions, AToM, …


UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Illustrative Demonstrators

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Technology Vision

CLARITY
-
SIXTH Sensor Gateway

Pre
-
packaged, off
-
the
-
shelf, sensor gateway;


Integrated NGN modem;

Configurable out
-
of
-
the
-
box;

OSGi
-
based Dynamic Web
-
Based Software Configuration;


CLARITY
-
SIXTH Sensor Deployment

Supports extensibility, heterogeneity and scalability of deployment;

Delivers autonomic sensor network management capabilities;


Seamless integration of cyber and physical sensor sources;


Abstraction of data streams, agnostic of source (physical or cyber);


CLARITY
-
SIXTH Data Fusion & Warehousing


Support for integration, analysis, fusion and archiving of data;


Dissemination of (personalised) data to key stakeholders;

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Personalised Insurance

Insurance Provider

I wish I could reduce

my insurance premium

by agreeing to certain

driving conditions

I wish I could

incentivise safer

driving… by monitoring

driving behaviour

?

?

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Personalised Insurance

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Home Services

How will I cope living alone?

How can we facilitate

independent living

for our aging population?

Medical Centre

How can I feel secure in my home…

How can I reduce my ever increasing

electricity bills?

How can we ensure the

security, safety, and well
-
being

of our aged community?

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Home Services

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Core Focus: Sensor Discovery

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

The Problem to Be Solved


Sensor Discovery


Approaches: Web
-
based versus Ad
-
hoc


Web
-
based well established, but ad
-
hoc less so


No integrated solution


Security


Harness existing solutions (existing encryption algorithms,
utilize IPv6 Security model, …)


Our Approach:


Offer integrated solution through SIXTH


Utilization of mobile phone as the integration platform


Validation through range of demonstrator applications.

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

OGC SWE Standards


Sensor Web Enablement (SWE) 1.0 Standard (2007)


Consists of Conceptual Models, XML Schemas & Web Services


Observations & Measurement
:
Supports transmission of sensor data


Sensor Model Language
:
Describes sensors systems and processes


Transducer Markup Language
:

Standard for describing transducers
and supporting real
-
time streaming


Sensor Observation Service
:
Web Service for
requesting, filtering, and
retrieving observations and sensor system information


Sensor Planning Service:
Web Service for requesting user
-
driven
acquisitions and observations.


Sensor Alert Service:

Web Service for publishing and subscribing to
alerts from sensors.


Sensor Web Enablement (SWE) 2.0 Standard


Currently Under Development as of 2011

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Web
-
Based Sensor Discovery






1: Uses an automated system to convert SWE Observations and Measurements to a custom
format.

2: Required an agreed level of metadata within SensorML to enable discovery

3: Requires users to subscribe, possibly with a fee

4: Must know type of sensor in advance of deployment

SWE
Compliant

Location
encoded

Sensor
Descriptions

Security

Web
Accessible

Sensor
Actuation

Low Level
Discovery

LinkedSensorData


1





X



X

X

OSIRIS






2

X



X

X

GSWSN

X








3

X

X

GSN

X



X
4

X



X

X

SIXTH Proposal















UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Ad
-
hoc Sensor Discovery






Less studied area, most focus on SWE
-
style
deployments

ZigBee

Bluetooth

GSM

Actuation

Security

TinyLime



X

X

X

X

In
-
Motes



X

X



X

Impala



X

X



X

SIXTH Proposal











UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Why Integrate?


Web
-
based approaches are more established:


Emerging standards exist


Are external to the underlying sensor network

-
Focus on data aggregation and smoothing

-
Time lags in receipt of data.


Ad
-
hoc discovery is more challenging:

-
No emerging standards or even accepted approaches

-
Heterogeneity must be handled in
-
network

-
Greater access to individual sensors

-
Provide access to real time raw data feeds

-
Integration allows us to harness the benefits of
both approaches in a single unified framework…



UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

The Solution: SIXTH &
Sensor Discovery


Modularity sits at the core of SIXTH:


Facilitates adoption of diverse discovery models ranging
from web
-
based approaches to ad
-
hoc in
-
network
approaches.


Aims to bridge divide between web
-
based and ad
-
hoc approaches.


Seamless transition between approaches:


Use web
-
based interaction when ad
-
hoc access is not
possible / available.


Support switching to ad
-
hoc interaction when possible.

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Example Demonstrator

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Use Case: Surfing Advisor 1


Consumer wishes to know the
weather/surf conditions at surfing sites
in his/her vicinity


User searches for this information on
his/her phone


The phone application automatically
connects to the sensors deployed at
the various locations.

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Use Case: Surfing Advisor 2


Remotely gathered information
is displayed in a contextually
sensitive manner


Various options are given an
intuitive rating


Information from multiple WSNs
are fused to give complete
description of area

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Use Case: Surfing


Upon arrival at the selected
location, the phone discovers the
WSNs via Zigbee/Bluetooth


receives updated telemetry from
the sensors


WSN information can be viewed
individually to make a choice as
to where in the area to go to

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Basic Funding & IP Model

Targeted Joint Project :

A specific dedicated project undertaken in collaboration with Vodafone;


Possibility with participation of another partner ( Alactel Lucent);


Ring Fenced IP;


Project Duration :

3 Year Duration;

6 Month Milestones;


Early and rapid prototype development and user trials;



Indicative Project Costing :

Dependant upon duration, scope. Typically this would involve:




Vodafone FTE 0.1 pa fully weighted




2 X UCD Post Doc (approx cost

50K per Post Doc Year)


300k




2 Ph.D Student 25k per annum







150k




Equipment











30k




Travel 3k per annum per person year






36k




Anticipated Overheads 40%








206k





TOTAL












722k







UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Vodafone Engagement

Exchange & Embedding of Staff for short durations :

Short term embedding and exchange of research staff between

CLARITY and Vodafone;


Market informed research;


Access to Vodafone Core Network :

Access and exposure to Vodafone mobile network test beds;


Access to Vodafone Network Engineers;


Support for Potential Spin out Company :


Potential investment in spin out company;

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Appendices

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

The Clarity Centre

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

University College Dublin

University College Dublin (UCD) has been
ranked as the
top university for Computer Science in Ireland, and
the only Irish university to be ranked within the top
100
in the world by the first ever international
subject ranking by the QS World University Rankings.



UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY Overview

UCD / DCU / TNI

100+ (PhD/PD) Researchers

plus Principal Investigators

Diverse Expertise

Health / Environment / Media

Strong Industry Focus

Award
-
Winning Research & Commercialization


UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

35

Research Team

Almost a decade of working together

Prof. Barry Smyth

CLARITY Director

RP 6 Leader

Prof. Alan Smeaton

Deputy Director

RP 5 Leader

Prof. Dermot

Diamond

RP1 Leader

Prof. Greg O’Hare

RP3 Leader

Prof. Noel

O’Connor

RP4 Leader

Dr. Brian Caulfield

RP3, RP6


Prof. Niall Moyna

RP1

Dr. Cian

O’Mathuna

RP2 Leader

Personalization, Recommender

Systems, User Modeling

Materials science, novel sensor

Technologies, wearables.

Physiotherapy, Human motion,

Body sensing technologies,…

Sports science, human

Performance, ….

Sensor platforms and hardware,

Power management, …

Middleware, agent oriented

computing, mobile computing.

Signal processing, audio/video

processing, data analysis.

Information retrieval, multimedia

Information, video retrieval,…

Dr. Donnacha

O’Driscoll

Centre Manager

2

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Summary Technical Programme

Devices & Platforms

Devices & Platforms



Content & People



Demonstrators

Sensor Web Middleware

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE



615,603



6,639,415



4,285,971



11,820,000



3,169,529



14,989,529

Total Centre Funding

Excq

Additional Industry

SFI

Core

Industry

Non
-
Excq

CSET Grant

Centre funding to date >

26m. 55% CSET Grant / 45% Additional (March2011)

IRCSET

EPA

SFI

EI

EU FP7

Marie

Curie

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Cumulative Publications

77

225

33

162

0
50
100
150
200
250
300
Journal
Conference
Actual
Target
139 additional non
-
CSET funded papers (93 conference, 46 journal).

Across the centre this represents a PI publication rate of approximately 20 papers p.a.

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

SOCIAL/AGENCY
COLLABORATORS

INDUSTRY
COLLABORATORS

CSET CORE

CLARITY Centre & Ecosystem

39

SOCIAL/AGENCY COLLABORATORS

INDUSTRY
COLLABORATORS

SOCIAL/AGENCY
COLLABORATORS

INDUSTRY COLLABORATORS

June 2011

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY Demonstrators

Personal Health &
Sports

Energy & the
Environment

Ambient Assisted
Living

Sensing the Real
-
Time Web

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY Demonstrators

1. Sensing the Realtime Web


The host of online services now available to us are regarded
as sensors
-

FaceBook, Twitter, FourSquare, etc.


Many examples of how these help in emergency and other
situations, but especially in non
-
emergency situations,
regular ‘transactions’ correspond to sensor values;


For text we can analyse sentiment, in real time;


For location
-
based services, we can combine these with
sensors from the physical world
-

environment, weather,
traffic, events, etc.


Companies involved in this work include IBM SmartCities
centre (Dublin), other SMEs.

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY Demonstrators

2. Personal Health and Sport


Applications in tennis, hockey, boxing, cycling, golf, stroke
rehabilitation, cystic fibrosis;


New sensing technologies for motion capture using our own
CLARITY WIMUs;


New sensing technologies for sensing the person through
respiration, perspiration;


Both of these are novel, unique, and benchmarked against
others, shown to be world
-
class;


Combine these with off
-
the
-
shelf sensors;


Company involvement from Disney, QinetiQ

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY Demonstrators

3. Energy and the Environment


We develop novel sensors for real time environmental
monitoring of water (phosphates and other nurtients) and air
(CO2, CH4, etc.);


We prototype these and build end
-
to
-
end systems which we
deploy in the field, working with Environmental Protection
Agency and Marine Institute;


Combine these with off
-
the
-
shelf sensors to create web
-
based visualisations of health of an environment;


With industry partners we deployed smart energy meters in
domestic/industry trials to monitor, incentivise and reward
customers through various interventions


This included appliance recognition


Company involvement from Episensor, IBM

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY Demonstrators

4. Ambient Assisted Living and Lifelogging


Lifelogging one of the most active research areas in CLARITY


Most
-
used device is SenseCam but also Looksie, VeeCam,
Android, wearable classes and others;


CLARITY AAL work on deployments of fall detectors, activity
profiling, disturbances in public places, energy monitoring;


Companies sponsoring this work include Microsoft Research,
IBM Research, FAST Search and Transfer (Norway), Research
Council of Norway, and previously Samsung Electronics
(Korea), Mitsubishi Electric Research Labs (US), HP Ireland.

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY Relationships

The industry partner slide

shown earlier shows current

industry engagement;

In addition we have 16

ongoing FP7 projects
-

large

multi
-
partner projects to

smaller STREPs.

Wide range of areas
-

energy management and smart
buildings, material science, healthcare, media

Very many industry partners, very industry
-
facing

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

Clarity Projects in the
Building Energy Management
Space

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY EU
-

EnPROVE

EnPROVE:
Maximising return of
investment (ROI) when investing on
energy saving solution

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY
-
FIEMSER


CLARITY
-
UCD


CSTB


THALES


TECNALIA Labein


Fraunhofer


Philips


Acciona


TENESOL

FIEMSER

(Friendly Intelligent Energy
Management System for Existing
Residential Buildings)

UNIVERSITY COLLEGE DUBLIN


DUBLIN CITY UNIVERSITY


TYNDALL NATIONAL INSTITUTE

CLARITY
-

HOBNET




RACTI



Ericsson



Mandat International



Sensimode



CLARITY
-
UCD



University of Geneva



University of Edinburgh