Input and Interaction

eyelashesnectarineSoftware and s/w Development

Nov 3, 2013 (3 years and 8 months ago)

57 views

Input and Interaction



Dr.
Yingcai

Xiao



A good user interface allows users to
perform interaction tasks with
ease

and
joy.


WYSIWYG

(What you see is what you
get).


Four basic interaction tasks:


position, select, quantify, text


Basic design principle:
Look and Feel



Hardware


Locators
:


relative devices: mice, trackballs, joysticks


absolute devices: data tablets, touch screen,
Kinect


direct devices: light pens, touch screens


indirect devices: mice, trackballs, joysticks


continues devices: mice, trackballs, joysticks


discrete devices: control keys


Keyboards
:


QWERTY(slow down typing)


Dvorak, order by frequency of use


alphabetic order


Valuators
:


bounded: volume control on radio


unbounded: clock

Choice Devices
:


function keys


foot switches

Haptic

Devices
:


pressure
-
sensitive stylus


force
-
feedback controls (
haptic
)



3D Interaction Devices


Joysticks with a shaft that twists for a
third dimension


Kinect

3D camera


Polhemus

3D sensors



VR: virtual reality, immersive, head
-
mounted


data glove


The Evolution of User Interface


CLI (Command Line Interface)


Keyboard


GUI (Graphical User Interface)


Mouse


NUI (Natural User Interface
)



Kinect

sensor (A/V)


Basic Interaction Tasks (BITS)


position: by pointing (GRAPHICS)


selection: by name (DB), by pointing


GUI: hierarchical pull
-
down menu, radio
-
buttons.


e.g. Format
-
>Paragraph…


text interaction: keyboard
--
>text
-
string


quantify interaction: dials, sliders


3D interaction tasks: Z value


multiple views, shift + button
-
down


gestures


voice




Composite Interaction Tasks (CITs)


dialogue boxes


Rubber
-
banding


Interaction
-
Technique Toolkits


get user input (control) ==>events


graphical output (feedback) ==>display


graphic device interfaces: GDI



X Windows Toolkit (UNIX)



Windows API (PC)



JAVA Swing


Standard APIs for input hardware: not there,
need standards.


NUI:
OpenNI
, MS
Kinect

SDK


Haptic
:
OpenHaptics

Toolkit