3D User Interfaces

natureplaygroundΤεχνίτη Νοημοσύνη και Ρομποτική

14 Νοε 2013 (πριν από 3 χρόνια και 6 μήνες)

54 εμφανίσεις

3D User Interfaces

from

Mobile
Devices


to Immersive Virtual
Environments

Habilitation à Diriger des Recherches

Université Bordeaux 1


December

3, 2010


Martin Hachet

Overall

objective

Improve

interaction
with

3D content

Easier
,
faster
, more
accurate


Motivation

Printing

Networks

Technological

advances

may

lead

to
societal

revolutions


Art,
industry
, science,
entertainment

and
so

on



particularly

after

general

public appropriations

Everyone

can

learn
,
communicate
,
create




Our goal: Open interactive 3D
graphics

to
everyone

by
designing

efficient 3D User Interfaces


Interactive

3D
graphics

Interaction in a 3D spatial
context

3D User Interfaces

3D UI

Challenges


Understand user motor and cognitive skills


Design new interaction techniques


Evaluate user performance


Invent new usages

Viewpoint control with Navidget

Object manipulation
with

the CAT

Positioning

3DUI

3D User Interfaces


VR

Virtual Reality


HCI

Human
-
Computer
Interaction


CG

Computer
Graphics


Overview


Mobile
devices

Touch
-
based

interaction

Immersive 3DUI

Conclusion and Future
work

Overview

2000

2003

2005

2007

2010

PhD

defense

INRIA

recruitment

HDR

defense

Team

Fabrice Dècle

2006
-
2009

w
ith Pascal Guitton


Sebastian Knödel

2006
-
2009

w
ith Pascal Guitton


Florent Berthaut

2007
-
2010

w
ith Myriam Desainte
-
Catherine


Aurélie Cohé

2009
-
2012

w
ith Pascal Guitton


Jérémy Laviole

2010
-
2013

w
ith Christophe Schlick


Joint project

INRIA


Université Bordeaux 1
-

CNRS (LaBRI)


Part one

Mobile 3DUI


2003
-

Creation

of
Iparla

3D
Visualization

and interaction on mobile
devices

3DUI


Mobile 3DUI

Hiking

assistant
[Mobile Spatial Interaction 2007]

Desktop HCI

(mouse)


Mobile HCI

(
e.g
.
thumb
-
based

)

?

Keystrokes

Adapting

discrete

input
space

to
continuous

3D
space




Jump’n’Refine


[CHI 07]

Z
-
Goto

[VRST 06]

Pen/
finger

input

Understanding

user performance and
adapting

3DUI

Elastic

feedback

[3DUI 08]

Sketchball

[
MobileHCI

09]

Multi
-
DOF

Extending

mobile input
space

for 3D interaction

Tangimap

[I3D 05, GI 05]

3DOF Controller

[CG&A 08]

Mobile 3DUI

Immersion on mobile
devices

is

limited

Small
screens
,
downgraded

rendering
,
lag


Improve

cognitive immersion
from

efficient 3D
UIs

Adapt

the
UIs

to the structure of the
task

-
«

discrete

» interaction
from

keystrokes

-
Multi
-
DOF interaction

Enrich

sensitive feedbacks

-
Elastic

sensing

-
Proprioception





Part two

Touch
-
based
interaction


2007


interaction on
touch
-
screens

Many

interactive
systems

become

available











Redefine

the
way

we

interact

with

digital content

New
opportunities

New challenges


2007


interaction on
touch
-
screens

Previous

work

Mainly
in the scope of 3D
modeling

(
sketching

interfaces
)

3DUI

Touch
-
based

3DUI

Desktop HCI

Touch
-
based

HCI

«

Teddy

»

Takeo

Igarashi

Navidget

From

mobile
devices

to immersive
virtual

environments






[3DUI2008]
best
paper

[IJHCS2008]

[VRST2008]

Ville européenne des Sciences

Grand Palais, Paris, 2008

Paris Air Show

Le Bourget, 2009

Navidget

for collaborative
work












ANR Project
Part@ge

:
Collaborative interaction

National network
-

academics

and
companies


Multi
-
touch











Many

examples

in 2D spatial
contexts

Very

little

work

for interaction
with

3D content

Multi
-
touch

Direct vs

Indirect interaction

tBox

3D transformation
widget

(9DOF)

InSTInCT

-

ANR
project



2009
-
2012





In
terfaces dédiées aux
S
urfaces
T
actile pour de




l’
I
nteraction avec des
C
ontenus
T
ridimensionnels





«

Touch
-
based

3DUI

»




INRIA Bordeaux
-

Iparla


INRIA Lille


MINT


Immersion


Cap Sciences


New interaction techniques

New
systems


for
general

public

http://anr
-
instinct.cap
-
sciences.net/

Part three

Immersive
interfaces


2000


Hémicyclia

CAT
Control Action Table

6DOF input
device

for interaction in front of large projection
screens




[egve2002]

[VRST2003]
best
paper

CAT & PSA, Salon européen
de la recherche 2006

SIGGRAPH 2005

2007


Exploration of VR interfaces for music

Florent
Berthaut’s

PhD

thesis
,
with

Myriam
Desainte
-
Catherine

Visualization

and interaction

Audio
-
visual

mappings

[ICMC2010]

3D
Reactive

widgets

[SBCM2009]



Interaction?


PIIVERT

[3DUI2010]

Graphical

interaction
with

virtual

rays

Direct percussion
gestures


DRILE:
hierachical

live
-
looping

[NIME2010]



Conclusion

3D
UIs

from

mobile
devices

to immersive VE

The standard desktop
paradigm

is

evolving

Improve
mobility

of
users

=
Iparla


Various

technological

contexts
, but
similar

approaches

Observe and
understand

Humans

and end
-
users

Learn

from

previous

work

(3D and 2D)

Find

good
controls

and feedbacks

Conduct

user
studies

Imagine,
Invent
,
Create


Addressing

clear

challenges
is

very

inspiring

Iparla
: 3DUI for mobile
users

Exploring

global directions
with

no
specific

goals, as
well
!

Music
-

VR

Perspectives

Mobile 3DUI

A lot
still

need

to
be

done

from

existing

/
upcoming

tech

e.g
. auto
-
stereo
, AR, Pico
-
projectors
,
remote

control…



Touch
-
based

3DUI

Touch
-
screens

everywhere

Many

3D
tasks

to
be

addressed


(
e.g
.
reassembly

tasks



cultural
heritage
)



Immersive interfaces

From

expert
users

to
general

public

Reinvent

immersive interaction


Perspectives


3DUI
tomorrow

?

CG ‘
needs
’ HCI

HCI
will


benefit

from

CG


e.g
.
creation

of 3D content

modeling
,
appearance
,
lighting
, and
so

on

Collaboration
with

HCI and CG experts



3DUI
is

a
key

research

topic

for the
coming

years
...

Questions ?

http://www.labri.fr/~hachet