Media and Augmented Reality

wrackbaaMobile - Wireless

Dec 10, 2013 (3 years and 8 months ago)

83 views

Using Mobile Technology for
Media and Augmented Reality

Jon A Preston & Jeff Chastine

Southern Polytechnic State University

ACMSE Conference, Mar. 25, 2011

Epic
Epicness

of Epic Proportions

A Little AR History


1968


Ivan Sutherland


Optical Combiner

A Little AR History


1992


Tom Caudell

and

David Mizell

coin the

term

“Augmented

Reality”







1994


Virtual Reality (VR) attempts to completely
synthesize


Augmented Reality (AR) integrates virtual
objects into the physical world

A Little AR History

Real

Environment

Virtual

Environment

(VR)

Mixed Reality

Augmented

Virtuality (AV)

Augmented

Reality (AR)

A Little AR History


1996


Rekimoto tracks in

6 DoF!


x, y, z


yaw, pitch, roll




1997


Azuma states three requirements:

1.
Combines the real and virtual worlds

2.
Interactive in real time

3.
Registered in 3D



A Little AR History

A Little AR History


1997


Feiner et. al

create the

“Touring Machine”


First mobile

augmented reality

system

A Little History


1999


ARToolkit


Free/Open Source


Kato/
Billinghurst


Good for intro to AR


Visual Tracking

(
ARToolkit
)

A Little History


2000


Landmark

breakthrough!


AR with Duran Duran

Hardware Requirements


HMDs/Displays


Rendering


Tracking



Tabletops


Tablets &

Phones


HMDs


Optical (see
-
through)


Stereo?


Video (closed
-
view)

Display


GPS, HA
-
GPS, GPS/RTK


Acoustic (IS
-
900)


Electro
-
magnetic (Polhemus)


Visual

(ARToolkit)


Tracking

AR Examples


Medical


Scientific
Visualization


Expert/Technician



16

Scenarios


Medical


Scientific
Visualization


Expert/Technician



17

Scenarios

Scenarios


Medical


Scientific
Visualization



Expert/Technician



18

AR in Education

Navigation

Nightvision

Commercial

Military



Tracking Accuracy


Optical vs. Video


Optical


High Resolution/
FoV
. Synching/Delay
issues, brightness issues


Video


safety: camera vs. eye offset


Registration Problems


location


lag in rendering


Weight
/
Battery Life


Interaction


Techniques


Physical objects


General Problems


Other Issues: Interaction

Example

Media
-
related Computing


It’s about motivating students


Media is cool


Mobile is cool


Media+Mobile must be
really

cool


Unity supports scripting


Basic programming concepts


Reinforces OO


Javascript or C# (or Boo)


Provides scaffolding to remove barriers (or at
least lower them)


Moving into Mobile

Nearest Tube

Layar

Moving into Mobile (2007)

Magic Books

Moving into Mobile


ARToolkit on an iPhone (2008)

Moving into Mobile (2009)

I MAED A GAM3 W17H AR 1N 1T


(not really, it’s called AAAARRRRRGH!)

Moving into Mobile


Need a good tracker


Qualcomm has released their free tracker!


Need a good/cheap display


P
hone is a window into the virtual world


Need a way to make games/render



Mobile AR Gaming

+

=

Easy AR!

How does it work?

Let’s make a Magic Book


Mark Billinghurst et al.


The hard part is finding a tracker…

Not anymore…

AR Preprocessed Images

(pictures + tracking information)

Into the ImageTargetTextures folder

Tracking XML file and data file

“Page” Textures

Into the Streaming Assets / QCAR folder

MagicBook Structure

AR Demo

Very Cool Unity Mobile API


Input.acceleration


Returns orientation as a Vector3


Input.GetKeyDown(KeyCode.Mouse0)


Screen tap event


iPhoneUtils.Vibrate()


Makes the phone vibrate


GPS/Location


Unity 3.2 or Java LocationManager

interface and native wrapper

Using accelerometers

Mobile in CS/CGDD


As we’ve said, it’s ubiquitous


Resources are constrained


Legitimate capstone experiences


Democratization of distribution

Why Mobile in the Classroom?

Trainyard

(case study)
-

http://struct.ca/2010/the
-
story
-
so
-
far/

iOS

with Cocos2D

Mobile SDKs


iOS

(good exposure to MVC)


Xcode


Cocos2D


Android


Eclipse


Android SDK


ADT plugin


Dalvik

Debug Monitor Server (DDMS)



ARToolkit


Free


Written in C


Uses
fiducials


http://www.hitl.washington.edu/artoolkit
/


What you’ll need:


A webcam


A printer


A compiler


Graphics card?

A safe place to get
started


Free


Works with Android


Java


JNI


C++


Runs on Qualcomm chipsets


HTC Incredible


Nexus One


Others


https://ar.qualcomm.com/qdevnet/

The Qualcomm AR SDK

Future Trends in AR

Gaming at SPSU & Georgia

Thank you!

Questions?