& the Natural User Interface

matchmoaningΤεχνίτη Νοημοσύνη και Ρομποτική

17 Νοε 2013 (πριν από 3 χρόνια και 8 μήνες)

78 εμφανίσεις

The Engaging User Experience
& the Natural User Interface

Tim Huckaby


InterKnowlogy Chairman/Founder


Actus
Interactive Software Founder & CEO

2

A little bit about me and why I am here…

The Engaging User Experience & the Natural User Interface

3

The Engaging User Experience & the Natural User Interface

About Tim, InterKnowlogy & Actus…

InterKnowlogy

(www.InterKnowlogy.com)

Tim Huckaby, Founder/Chairman (TimHuck@InterKnowlogy.com)


13+ year old services firm


Custom Application Development


focused on building NUI solutions


Web, mobile, and desktop


Windows 7/8,
PixelSense
, WP7/8, Azure, Kinect, XAML stack



-

Largest Client: Microsoft

Actus Interactive Software
(www.Actus
-
Software.com)

Tim Huckaby, Founder/CEO (
TimHuck@Actus
-
Software.com
)


Software Product Company


Interactive Kiosk and Active Digital Signage


Multi
-
Touch, Gesture, and Voice Driven Solutions

The Engaging User Experience & the Natural User Interface

NUI enabled applications improve the communication, education and
user experience across the software continuum.


Objectives And Agenda

There are a number of tenants of a great user interface that will last
the test of time


The
4 Manifestations of NUI: Multi
-
Touch, Vocal, Gesture, Neural

Where We have Been and Where we are Going

Demos, Demos, Demos….


The
Natural User Interface (NUI)

5

The Engaging User Experience & the Natural User Interface

NUI: The Natural User Interface

Multi
-
Touch Capable


Common Gestures of Touch


Physical Object Interaction


Virtual Object Interaction

Gesture Capable


Motion Based Interface


Tracking of full
-
body movement, facial expression, and voice with precision


Voice Capable


Multi
-
array Microphone


Uniquely Distinguish Audio & Voices

Nueral Capable


Conscious and non
-
conscience interfaces


Non Invasive


January 27, 2010

6

The Engaging User Experience & the Natural User Interface

7

The Engaging User Experience & the Natural User Interface

8

We have come a long way…

8

The “Green Screen”

8

The Engaging User Experience & the Natural User Interface

9

The Engaging User Experience & the Natural User Interface

Image Courtesy of Computer History Museum

10

The Engaging User Experience & the Natural User Interface

Touch Capable Computing Devices

Are Not New

Past

1972: PLATO IV

Touch Screen Terminal

The Samsung SUR40 for
Microsoft PixelSense

Windows 8
-

Metro

Apple iPad

Present

Future (now)

11

The Engaging User Experience & the Natural User Interface

What is Relatively New is:


Inexpensive Touch Capable, Non Proprietary Hardware


A Operating Systems designed for Multi
-
Touch


A Consistent Multi
-
Touch API for the major Hardware/Software
Platforms


Developer Productivity in Touch Capable Apps


The Forecast of Multi
-
Touch Hardware Capability in Every New
Computing Device in the Short Term

The Engaging User Experience & the Natural User Interface


The “Cancer App”

The “
Autocad

App”





Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


The Engaging User Experience & the Natural User Interface


Grey’s Anatomy



Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


The Engaging User Experience & the Natural User Interface


Gesture Heart



Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


The Engaging User Experience & the Natural User Interface


EMN8



Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


16

The Engaging User Experience & the Natural User Interface

HTML 5 Touch Events, Version 1

W3C Working Draft 24 January 2013




Source: https://dvcs.w3.org/hg/webevents/raw
-
file/tip/touchevents.html

Defines a set of low
-
level events that represent one or more points of
contact with a touch
-
sensitive surface

Changes of those points with respect to the surface and any DOM elements
displayed upon it (e.g. for touch screens) or associated with it (e.g. for
drawing tablets without displays).

Addresses pen
-
tablet devices, such as drawing tablets, with consideration
toward stylus capabilities.

“This
specification is the 24 January 2013 Last Call Working Draft. The
comment period for this Last Call Working Draft ends 14 February 2013
.”

17

The Engaging User Experience & the Natural User Interface

The Engaging User Experience & the Natural User Interface

The Engaging User Experience & the Natural User Interface


Democratic National
Convention Voting App



Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


The Tenants of an Engaging UX

Use the
Power
of
Faces


People love
faces; We see faces where they don’t exist


We have DNA with the sole purpose of recognizing
faces


Take advantage of this by putting faces on your
App


Have the faces
to look
at
important part of your
App


People
instinctively follow the eyes of the face
.

Use
Food
,
Sex
and
Danger


W
hen
someone sees something new, they place it into one of four categories
:

1.
Can
I
Eat it?

2.
C
an
it
Eat
M
e?

3.
C
an
I
Mate
with
it?

4.
…and
everything else.



If
you want your
App to
be
engaged and interesting
, put it in one of the
first three categories
.

20

The Engaging User Experience & the Natural User Interface

The Tenants of an Engaging UX

21

The Engaging User Experience & the Natural User Interface

Tell
a
story


We learn through
stories
. It’s how we teach our children. It’s the
Bible; It’s
what we see in
movies.



Stories
are a big part of how information is conveyed to us.


If
you have information to give to the user, put it in story form.


It
doesn’t matter what medium you use (words, pictures, music), but using a story narrative
will help your user understand and retain your information
.


Build
commitment over time


Let the user choose how they want to interact with you (RSS, Twitter, Facebook
)


Make
sure that you don’t take advantage of the trust that is implicit in that interaction
.

Use Natural Interactions of Objects


Natural Movements


Fluidity


Animate / Exaggerate: Slow things down so the eye can follow


22

The Engaging User Experience & the Natural User Interface

What is also Relatively New:

User Experience with Naturally Behaving
Objects


Large Form Factors demand natural behaviors


The User Experience is “never done”


It can always be improved


Tablet Computing paved the way


Software Physics Engines are readily available in
open source

22

The Engaging User Experience & the Natural User Interface


Fluid Layout

Pixelsence

Craps




Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


24

The Engaging User Experience & the Natural User Interface

“Game
-
ification”

User Experiences that Enhance Learning

Learning made Fun / Entertaining

Proven as a learning tool beyond just Children

Computer based Games are a significant part of popular
culture

Educational Video Game Curriculums


MIT, UC Irvine, Minnesota, Michigan State, etc.

The Engaging User Experience & the Natural User Interface


NASA
Marsbound




Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


Kinect for Windows

26

World's Fastest
-
Selling Consumer Electronics Device

… a Future Beyond Gaming

Combination of RGB camera, depth sensor and multi
-
array microphone


RGB camera delivers three basic color components


Depth sensors “sees” in 3
-
D


Microphone locates voices by sound and excludes ambient noise

Consumer Priced: $249.99

Tracks full
-
body movement, facial expression, and voice with precision

Kinect sensor bar scans and monitors 1 million points on the body

Kinect for Windows SDK


Skeletal Tracking


Face, Gesture Recognition


Audio Echo cancellation


Audio Beam Forming


Speech Recognition


Machine Learning

The Engaging User Experience & the Natural User Interface

The Engaging User Experience & the Natural User Interface


Kinect for Windows:

Actus Interactive Digital Content System (Kiosk)

IK Physical Therapy

IK Touch
-
less Operating Room





Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


28

The Engaging User Experience & the Natural User Interface

Kinect for Windows Competitors

Leap Motion


$70


https://leapmotion.com


Not available yet


SoftKinetic


http://www.softkinetic.com


$249


Distance and Near Mode


Multiple Products


In the space for over a decade


Panasonic


Works outside in broad daylight


$2,600

30

The Engaging User Experience & the Natural User Interface

Neural Interfaces:

Conscious and Non
-
Conscious

High fidelity EG acquisition device

No conductive gel, etc.

Non
-
invasive


Use Case Examples:


Conscious: mind manipulation of objects


Non
-
Conscious: Ranking music


First target market: gaming


$300!!!

The Engaging User Experience & the Natural User Interface


Emotiv



Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


32

The Engaging User Experience & the Natural User Interface

We are within a decade of building the
Holodeck

“The Ultimate NUI Application”

The Engaging User Experience & the Natural User Interface


HoloDesk

-

Direct 3D
Interactions with a Situated See
-
Through Display



Tim Huckaby


Founder, InterKnowlogy & Actus Software


Microsoft RD & MVP


34

The Engaging User Experience & the Natural User Interface

Summary

We are at the cusp of a revolution in software & hardware


Using Natural User Interface (NUI) technologies improve the User
Experience

The hardware, tools, plumbing and platforms for NUI computing are
powerful and available now.
…and will just continue to get better, cheaper, powerful and
more available

Within a realistic time frame NUI computing will be the norm

The concepts of NUI change the way we design and build software

There are a number of design tenants that can enhance User Experience

The Engaging User Experience & the Natural User Interface

More info on InterKnowlogy:


www.InterKnowlogy.com


Silverlight.InterKnowlogy.com


www.vimeo.com/InterKnowlogy


More info on Actus Software:


www.Actus
-
Software.com


About Tim Huckaby…


Founder/Chairman, InterKnowlogy


Founder/Chairman, Actus Software


Microsoft® Regional Director


Southern California


Microsoft® .NET Partner Advisory Council Founder / Member


Microsoft® MVP


Kinect for Windows


INETA Speaker


International .NET Users Group
Association


Board Member: Association for Competitive Technology


Board Member:
DevIntersection


Board Member: Microsoft Healthcare Partner Advisory Board


Author / Speaker

Contact me
:


E
-
mail
:




TimHuck@InterKnowlogy.com

TimH@Actus
-
Software.com

Phone:


Office
:
760
-
444
-
8640


Mobile:
:
619 990 9200

Blog
:

http
://team.interknowlogy.com/blogs/timhuckaby


FaceBook
:

http://www.facebook.com/Tim.Huckaby.Carlsbad


LinkedIn:

http://www.linkedin.com/in/timhuckaby


Twitter:
@
TimHuckaby

Tim Huckaby