CH1: Introduction to Multimedia

parisfawnΤεχνίτη Νοημοσύνη και Ρομποτική

17 Νοε 2013 (πριν από 3 χρόνια και 10 μήνες)

105 εμφανίσεις

Multimedia
Systems

Mohammad H. Alomari
, PhD

Head, Computer Science Department

Applied Science University

Emails:

m_alomari@asu.edu.jo


m.h.al
-
omari@bradford.ac.uk

Web:

http://alomari.info


http://spaceweather.inf.brad.ac.uk

CH1: Introduction
to Multimedia

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
2

1.1 What is Multimedia?


When different people mention the term multimedia, they
often have quite different, or even opposing, viewpoints.


A PC vendor: a PC that has sound capability, a DVD
-
ROM drive, and
perhaps the superiority of multimedia
-
enabled microprocessors that
understand additional multimedia instructions.


A consumer entertainment vendor: interactive cable TV with hundreds of
digital channels available, or a cable TV
-
like service delivered over a
high
-
speed Internet connection.


A Computer Science (CS) student: applications that use multiple
modalities, including text, images, drawings (graphics), animation, video,
sound including speech, and interactivity.


Multimedia and Computer Science:


Graphics, HCI, visualization, computer vision, data compression, graph
theory, networking, database systems. Multimedia and Hypermedia

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
3

Components of Multimedia


Multimedia involves multiple modalities of text,
audio, images, drawings, animation, and video.



Examples of how these modalities are put to use:

1.
Video teleconferencing.

2.
Distributed lectures for higher education.

3.
Tele
-
medicine.

4.
Co
-
operative work environments.

5.
Searching in (very) large video and image databases for
target
visual objects.

6.
“Augmented” reality: placing real
-
appearing computer graphics
and video objects into scenes.

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
4

7.
Including audio cues for where video
-
conference
participants
are located.

8.
Building searchable features into new video, and enabling very
high
-

to very low
-
bit
-
rate use of new, scalable multi
media
products.

9.
Making multimedia components editable.

10.
Building “inverse
-
Hollywood” applications that can recreate the
process by which a video was made.

11.
Using voice
-
recognition to build an interactive environment,
say a kitchen
-
wall web browser.

Components of Multimedia

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
5

Multimedia Research Topics and Projects


To the computer science researcher, multimedia
consists of a wide variety of topics:

1.
Multimedia processing and coding: multimedia content analysis,
content
-
based multimedia retrieval, multimedia security,
audio/image/video processing, compression, etc.

2.
Multimedia system support and networking: network protocols,
Internet, operating systems, servers and clients, quality of service
(
QoS
), and databases.

3.
Multimedia tools, end
-
systems and applications: hypermedia systems,
user interfaces, authoring systems.

4.
Multi
-
modal interaction and integration: “ubiquity” web
-
everywhere
devices, multimedia education including Computer Supported
Collaborative Learning, and design and applications of virtual
environments.

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
6

Current Multimedia Projects


Many exciting research projects are currently underway.
Here are a few of them:



Camera
-
based object tracking technology
: tracking of the control
objects provides user control of the process.



3D motion capture
: used for multiple actor capture so that multiple real
actors in a virtual studio can be used to automatically produce realistic
animated models with
natural movement.



Multiple views
: allowing photo
-
realistic (video
-
quality) synthesis of
virtual actors from several cameras or from a single camera under
differing lighting.



3D capture technology
: allow synthesis of highly realistic facial
animation from speech.

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
7


Specific multimedia applications
: aimed at handicapped
persons with low vision capability and the elderly


a rich
field
of endeavor.



Digital fashion
: aims to develop smart clothing that can
communicate with other such enhanced clothing using wireless
communication, so as to artificially enhance human interaction in
a social setting.



Electronic House call system
: an initiative for providing

interactive health monitoring services to patients in their
homes



Augmented Interaction applications
: used to develop
interfaces between real and virtual humans for tasks such
as
augmented storytelling.

Current Multimedia Projects

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
8

1.2 Multimedia and Hypermedia


History of Multimedia:



Newspaper
: perhaps the
first

mass communication medium,
uses text, graphics, and images.



Motion pictures
: conceived of in 1830’s in order to observe

motion too rapid for perception by the human eye.



Wireless radio transmission
:
Guglielmo

Marconi, at
Pontecchio
, Italy, in 1895.



Television
: the new medium for the 20th century, established

video as a commonly available medium and has since changed

the world of mass communications.

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
9

Hypermedia and Multimedia


A hypertext system: meant to be read nonlinearly, by
following links that point to other parts of the document, or
to
other documents (Fig. 1.1)



HyperMedia
: not constrained to be text
-
based, can include
other media, e.g., graphics, images, and especially the
continuous media


sound and video.



The World Wide Web (WWW)


the best example of a
hypermedia application.



Multimedia means that computer information can be
represented through audio, graphics, images, video, and
animation in addition to traditional media.

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
10

Fig 1.1: Hypertext is nonlinear

Hypermedia and Multimedia

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
11


Examples of typical present multimedia
applications include:


Digital video editing and production systems.


Electronic newspapers/magazines.


World Wide Web.


On
-
line reference works: e.g. encyclopedia, games
.


Interactive TV.


Multimedia courseware.


Video conferencing.


Video
-
on
-
demand.


Interactive movies.

Hypermedia and Multimedia

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
12


Education and training


Leisure and entertainment


Information provision


Virtual reality and simulations


Combined areas

Major uses of multimedia systems

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
13

Information processes in multimedia systems

1.
Collecting:

When collecting data, we need to
consider what data needs to be collected and
how to collect such
data.


2.
Processing:

Multimedia systems need to
process data for presentation. This covers the
aspects of how text, number, audio, image,
animation and video are integrated into the
system.


COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
14

3.
Organizing:

In order to organize a presentation
from a multimedia system, we need to look at
using a storyboard to show the flow of the
screens.

4.
Storing and
Retrieving:

There are various file
formats used in multimedia systems that enable
data to be stored and retrieved. Some of these
formats
are:


JPEG
,

GIF,

PNG

and

BMP

for

images


Quicktime
,

MPG,

AVI

and

WMV

for

video

and

animations


MP
3
,

Wav,

WMA

and

MIDI

for

audio



SWF

for

animations


Information processes in multimedia systems

COMPANY LOGO

Copyright © Li & Drew | Updated Version Copyright © 2012 Applied Science University
15

Components of a Multimedia System

1.
Capture devices:

Video Camera, Video Recorder, Audio
Microphone, Keyboards, mice, graphics tablets, 3D input
devices, tactile sensors, VR
devices, and Digitizing
Hardware.

2.
Storage Devices:

Hard disks, CD
-
ROMs, DVD
-
ROM,
etc

3.
Communication Networks:

Local Networks, Intranets,
Internet, Multimedia or other special high speed networks.

4.
Computer Systems:
Multimedia Desktop machines,
Workstations, MPEG/VIDEO/DSP Hardware.

5.
Display Devices:

CD
-
quality speakers, HDTV,SVGA, Hi
-
Res monitors, Color printers etc.

Thank You