By Mr. Muyowa Mutemwa Supervisor: Dr W D Tucker Co-Supervisor: Mr. M Norman

safflowerpepperoniΚινητά – Ασύρματες Τεχνολογίες

24 Νοε 2013 (πριν από 3 χρόνια και 8 μήνες)

98 εμφανίσεις

By Mr. Muyowa Mutemwa

Supervisor: Dr W D Tucker

Co
-
Supervisor: Mr. M Norman


Deaf with a capital 'D' is different from deaf or
hard of hearing.


Deaf people primarily use sign language to
communicate


A
nd

define their sense of culture, as opposed
to the other groups that use spoken,
and
textual
, languages like English or Xhosa
.
.



User trials done with Deaf Community of Cape
Town (DCCT).


SignSupport

is a
system that will ease
communication between a Deaf and hearing
users.


A set of web pages,

?C
E
ach page has a combination of SASL videos and
English text

?C
To enable a Deaf person to tell a hearing person (e.g.
doctor) how
s
/he is feeling.



Requires a mobile phone with:


A

data connection

?C
And a

browser that supports Adobe Flash video (FLV).



The central problem that this research work
seeks to address is “
can we develop a model
using Adobe Flash technology on a mobile
phone that will ease communication between
hearing users and users who primarily use
SASL for communication? ”.



Communication between a hearing person
and a Deaf person requires an interpreter.


Most public workers such as doctors, train
ticket sellers, policemen cannot sign.


Technology in South Africa is not as
supportive towards Deaf people like in
England, they have TESSA in public places
such as post offices.


Most Deaf people in South Africa rely on
neighbors and family members for
emergency situations.


Most Deaf people can use computer, but they
have to travel for long distances to use of
them


While they carry their mobile phones with
them at all times.


By combining video with the text, it can be
for educational purposes.


I intend on learning sign language while
doing this study.



provide a semi
-
synchronous communication aid
on a mobile phone for SASL users to be able to
communicate with hearing users in public places.


Sub
-
aims:


put the
Signsupport

on a mobile phone.


experimenting with the video quality for SASL
visualization.


create internet pages for Wireless Access Protocol (WAP)


create a lookup dictionary of videos for the hearing
user’s response.


This system is not designed to a replace a public worker


Deaf telephony projects have been conducted
with DCCT members at the Bastion over the
years.


As a result Deaf people there have become
accustomed to using information and
communication technologies (ICT) at a small
'internet
caf
é

.


Most Internet usage at the Bastion involves visual
media, educational programmes in sign
language, and Deaf channels on Youtube.


Results indicate that Deaf users prefer to use
SASL to communicate, they can also use text but
their skills are limited.


DCCT members tend to own low
-
end mobile
phones with low
-
resolution cameras and
narrow bandwidth data connectivity
.



Deaf users do not take advantage of low cost
text messaging like M
x
it.



They might be more inclined to use data
services if content were available in SASL on a
mobile phone.


TESSA (UK), is a Text and Sign Support
Assistant, for people who are deaf or hard of
hearing.


TESSA combines speech recognition
technology and virtual human animation.


Video calling is available on advanced mobile
phones,


but the poor resolution and low frame rate of
the video remains unacceptable for SASL
communication,
speech is still a priority here.


T
he YouTube client is available for a limited
number of phones and mobile operating
systems.



Most video playbacks of on mobile devices
come in the form of third party media
players.



Skyfire

(
www.skyfire.com
) is a cross platform
browser that enables
Video streaming.


Flash Lite 3 brings engaging experiences like
web content and streaming video to a mobile
phone.


Looijesteijn’s

industrial design


Testing


We tested a mock
-
up of the PC
-
based prototype of
SignSupport

at the
Bastian.


4 Deaf users split into pairs


Storyboard


At the end of trial semi structured interview


Recording using a video camera for further analysis


Results


Overall, the users indicated that they would like to
see the prototype developed further.


Participants


Deaf people who use sign language as their primary
source of communication with other deaf people
and hearing people who do not sign.



DCCT staff member who were involved in the
computer
-
based prototype done by
Looijesteijn
.



10 Deaf people will help in the re
-
designing of
Signsupport
, focus group.



4 Deaf people will evaluated the mobile
-
based
prototype.


Materials


mobile phone,


mobile phone browser,


a video camera,


& Adobe Flash program.


Design


User Trial

Literature survey

User survey

Requirement Analysis
Developement

Design

Prototype
Implementation

Prototype Testing

Report Compilation

Project Design cycle


Data collection


semi
-
structure interviews,


questionnaires,


discussion like interview,


& a video camera to capture the user trail.


Using
Skyfire

our intention is to design the
next prototype with 'plug and play' scenarios,
of which the doctor's visit is just one.



Experiment will be done with content stored
on (
client
-
side video storage
)


and off (
server
-
side video storage
) the device.



text lookup vs. sign lookup
, by designing a
clickable image of the entire body and having
questions for part that can be clicked.



1.
Introduction

2.
Overview of project

3.
Literature survey

4.
Prototype design

5.
Research findings and analysis

6.
Conclusion



The initial
SignSupport

mock
-
up on the PC
showed a potential to help Deaf users to
communicate with people that do not sign.


The next version of
SignSupport

will run in a
mobile browser and allow multiple content
modules.


We will continue to conduct user trials with
Deaf participants to provide a solution that is
useful for them.



T
esting

will resemble that of the PC mock
-
up,
but on a mobile phone.




Q & A