3-D Sound and Spatial Audio

3
-
D Sound and Spatial Audio

MUS_TECH 348

Additional 3D Sound Applications

3D Sound in Information
Technologies and Communication

3D Sound in Information Technologies and
Communication

Teleconferencing Technologies

Auditory Displays

Auditory Information:

•
Speech

•
Non
-
speech

•
Alarms and warning messages
-

people react faster to auditory
alarms than visual ones

•
Status and monitoring messages
-

noticed when a change occurs

•
Encoded Signals
-

data
sonification

General computer auditory GUI

Auditory Displays

Auditory Icons

(Gaver): everyday sounds in the user
interface clicks , emptying trash; Foley
-
like sounds for
increased reality

Example:

Selecting a file

Tapping on the object

Size:


extent
-

width, loudness

Content:


material
-

wood, metal, etc.

Fullness:


hollow, solid

Location:

3d position, distance, reverb

Examples:

•
Sonic Finder

•
VRML (3D version of HTML)


Special Applications:

•
Audio windows for communications

•
Auditory Displays for Avionics

•
Audio GUI’s for the visually impaired

Auditory Displays

Scientific visualization is the technique of presenting complex
data for study. The data is typically multidimensional and
too complex for 2D graphs. Visualization systems often
organize the data for presentation utilizing multiple sensory
modalities.

Scientific Visualizatin

Auralization is the
techniques of
simulating the
acoustics of a space
that is
computationally
modeled. The
purpose is typically to
test the acoustics
prior to buidling the
space.

Auralization

Virtual Reality Systems

1.
Reality engine

with algorithms for
organizing and creating the visual,
auditory and haptic illusions

2.
Effectors
, the hardware devices that
provide the users with sensory
information such as head
-
mounted
displays, headphones, force
-
feedback devices.

3.
Sensors
, the hardware devices that take
in data from the user such as position
trackers, multi
-
dimensional track
balls, speech analyzers, data gloves

Virtual Reality Systems

CAVE technology provides an alternative
to head
-
mounted displays

MPEG
-
4 is the basis for
the evolving standard for
home computer/
entertainment systems. It
assumes a VR
-
oriented
approach to the interface.


It incorporates and
supercedes VRML.

Auditory Displays

Telepresence

Telepresence

a human/machine system in which the human
uses of (head
-
mounted) displays and body
-
operated remote
actuators and sensors to control distant machinery.
Provides a virtual environment for humans to control
devices, robots, etc., in a hostile or remote real
environment. The ability to control the camera view gives
a completely different emotion impression of the
environment rather than remote viewing, which is similar
from a hardware perspective, but not a personal
perspective.

Telerobotics

Telerobotics

is the area of robotics that is concerned with the
control of robots from a distance, chiefly using wireless
connections. It is a combination of two major subfields,
teleoperation and telepresence. Teleoperation means
"doing work at a distance", although by "work" we mean
almost anything. What we mean by "distance" is also
vague: it can refer to a physical distance, where the
operator is separated from the robot by a large distance, but
it can also refer to a change in scale, where for an example
a surgeon may use micro
-
manipulator technology to
conduct surgery on a microscopic level.

Applications:



•
Subsea

•
Hazardous

•
Pipeline inspection

•
Remote Surgery

•
Education

•
Advertising and sales

•
Entertainment

•
Telepresence Art (
Eduardo Kac)

Telepresence/Telerobotic

Entertainment Applications

IMAX has been a leader in bringing 3D sound to popular venues