GESTURE ANALYSIS IN HIGH

sandpaperleadΛογισμικό & κατασκευή λογ/κού

31 Οκτ 2013 (πριν από 3 χρόνια και 9 μήνες)

83 εμφανίσεις

©2007
-
2011 SoftKinetic. All Rights Reserved.

ENABLING GAME EXPERIENCES BY
GESTURE ANALYSIS IN HIGH
RESOLUTION 3D

©2007
-
2011 SoftKinetic. All Rights Reserved.

2D is not enough |
We
need 3D for size, order etc.


Health

Automotive

Sport & Fitness

Video

conference

Entertainment

Television

Events

VR Training

Applications

©2007
-
2011 SoftKinetic. All Rights Reserved.

2

| Gesture Analysis | June 16
th

, 2011

VISION

“To
transform the way people
interact
with
the digital
world.”


MISSION

“To
be the leading provider of 3D
imaging
& gesture
recognition
platforms.”


Hardware

Middleware

Applications

3D Camera & Sensor

Product Family
DepthSense



3D gesture
-
based
games & applications

by
SoftKinetic Studios

3D Gesture Recognition

Middleware:
iisu



©2007
-
2011 SoftKinetic. All Rights Reserved.

Overview

|
3D
Resolution

\

DepthSense

camera

\

iisu

SDK gesture recognition middleware

\

In
-
game experience


Interaction
Designer
TM

3

©2007
-
2011 SoftKinetic. All Rights Reserved.

DepthSense |
3D Camera

Time
-
of
-
Flight (ToF)

Advanced & Patented
DepthSense

Technology



4

©2007
-
2011 SoftKinetic. All Rights Reserved.

DepthSense |
3D Camera








5

3D Technology Evolution



Time
-
of
-
Flight

New Technology


NOW

resolution

customization

downscaling

Other 3D Technology

Multi
-
camera

©2007
-
2011 SoftKinetic. All Rights Reserved.

DepthSense |
3D Camera








6

Time of Flight = flexibility

Lateral
resolution
Depth resolution
Field of View
Volume of
Interest
Frame Rate
Lens
Specifications
Pixel Pitch
Optical Power
Physical Laws
Economics
(BOM, etc)
System Size
Scene
requirements
©2007
-
2011 SoftKinetic. All Rights Reserved.

Accelerate Gesture Interface Development

7

Analysis of the user from the depth measurements

is
directly usable
in your interface
.

How?

\

ToF

+ driver + iisu stack does the user analysis at the
Bubbleman

size.

\

Interaction Designer lets you easily choose your parameters
.

©2007
-
2011 SoftKinetic. All Rights Reserved.

iisu |
3D Gesture Recognition Middleware

Analyze the User

8

©2007
-
2011 SoftKinetic. All Rights Reserved.

Interaction Designer


Already integrated with Unity
®
/ Flash
®

Easy integration with any 3D Engine.




9

What does it do?

\

Easy
-
to
-
use application.

\

Allows easy prototyping and production.

\

Test & refine gestures in real
-
time.

\

Use pre
-
recorded video footage.


©2007
-
2011 SoftKinetic. All Rights Reserved.

10

iisu SDK |
Modular Stack & APIs

Interaction
Designer

Unity 3D
®

Virtools
®

iisu

Tools

Plug
-
Ins

Other modules

Refine to User
-
level Primitives


Iisu

Users

API

iisu

Volume

Body parts

iisu

Skeleton

API

Depth
-
map Processing

iisu

Scene

API

3D
Avatar

Upper
Body & Hands

iisu

Parts

Standardized
3D Depth
-
map |
Sensor
Calibration

iisu

Source

API

Flash
®

API

API

API

Scaleform
®

iisu

UI

10

©2007
-
2011 SoftKinetic. All Rights Reserved.

SoftKinetic |
3D Game Experience


Enhancing Creativity:



\

Not just the technology & tools, but also applications.

\

Video games, user interfaces, serious games.



A Completely
Markerless

User
-
Experience:

\

No gloves, headsets, special clothing or accessories.



Works Under all Conditions:

\

Does not require any special lighting conditions.

\

Adapts to any scene
-
setting: home (video game),


arcade and fitness centers etc.

\

Allows several users in the scene (family/arcade).

11

©2007
-
2011 SoftKinetic. All Rights Reserved.

12

What’s Next? |
Faster Processing = More 3D


12

©2007
-
2011 SoftKinetic. All Rights Reserved.

What’s Next? |

Higher Resolution

In the
DepthSense
camera:


/

More X
-
Y resolution in depth.

/

Better depth uncertainty.

/

More X
-
Y resolution in color.

/
Synchronized RGB+Z.

/

Higher frame
-
rate.

13

Volume

Low

High

Video Games

TV & PC

User
Interface

Arcade

Active Gaming

& Fitness

Sensitivity to 3D
Camera Price

Low

High

Serious
Games

Advergames

©2007
-
2011 SoftKinetic. All Rights Reserved.

Gesture recognition within iisu:

\

Wider field of view.

\

Finer detection.

\

Biometric ID.

\

More robustness.



14

What’s Next? |
Higher Resolution

\

Try iisu
Freemium

\

iisu 3.0
upcoming

©2007
-
2011 SoftKinetic. All Rights Reserved.

In
-
game experience:

\

Lower latency.

\

100% immersive, transparent & intuitive
gameplays
.

\

Creativity boost for aesthetics and interaction.

15

What’s Next? |
Higher Resolution

©2007
-
2011 SoftKinetic. All Rights Reserved.

Challenges

|

Higher Resolution

Using the stack for higher resolution:

\


Data transfer bandwidth.

\


Host processing

requirements to deal

with more data, faster.




16

©2007
-
2011 SoftKinetic. All Rights Reserved.

Thank You!


Mitch
Reifel

mhr@
softkinetic.com


www.SoftKinetic.com


www.youtube.com/SoftKinetic

www.facebook.com/SoftKinetic

Twitter: @SoftKinetic


©2007
-
2011 SoftKinetic. All Rights Reserved.

Disclaimer & Attribution

The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissio
ns
and typographical errors.


The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limi
ted

to product and roadmap changes, component and motherboard version changes, new model and/or product releases, product
differences between differing manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. There is no
obligation to update or otherwise correct or revise this information. However, we reserve the right to revise this informatio
n a
nd to
make changes from time to time to the content hereof without obligation to notify any person of such revisions or changes.


NO REPRESENTATIONS OR WARRANTIES ARE MADE WITH RESPECT TO THE CONTENTS HEREOF AND NO
RESPONSIBILITY IS ASSUMED FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS
INFORMATION.


ALL IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE ARE EXPRESSLY
DISCLAIMED. IN NO EVENT WILL ANY LIABILITY TO ANY PERSON BE INCURRED FOR ANY DIRECT, INDIRECT, SPECIAL
OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF
EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.


AMD, the AMD arrow logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. All other names used in
this presentation are for informational purposes only and may be trademarks of their respective owners.


The contents of this presentation were provided by individual(s) and/or company listed on the title page. The information an
d
opinions presented in this presentation may not represent AMD’s positions, strategies or opinions. Unless explicitly stated,

AM
D is
not responsible for the content herein and no endorsements are implied.