Kyota Aoki - kyota@is.utsunomiya-u.ac.jp Masaki Kimura - kimu7@softcdc.co.jp Shinjiro Murayama - cjc42970@ams.odn.ne.jp

chemistoddΤεχνίτη Νοημοσύνη και Ρομποτική

6 Νοε 2013 (πριν από 3 χρόνια και 9 μήνες)

77 εμφανίσεις

Kyota Aoki
-

kyota@is.utsunomiya
-
u.ac.jp


Masaki Kimura
-

kimu7@softcdc.co.jp


Shinjiro Murayama
-

cjc42970@ams.odn.ne.jp


We propose the novel 2
-
dimensional
information presentation method
through tactile perception
.


A Pin array display is good enough for an
image presentation.


It is expensive and heavy.


A haptic paper is good as a map.


It is a fixed image.


Virtual tactile graphic display is very good for
visually impaired persons[1].



The proposed method enables to share the same
display with visually impaired persons and sighted
persons.


This helps to work together.


A visually impaired person may ask “Who is this?”
with pointing a face on the display.



The propose method acquire the
absolute position directed by a
finger.


A
tactile stimulator at the
finger
generates the tactile stimulation at
the finger
.


Image input


Image transformation


Image presentation


Tactile stimulation based on the
transformed image.


A tactile stimulator is placed at the point
where the stimulation is needed.


This
makes close
action and reaction
loop. The user
of
the
proposed system
directs the position
on a touch panel with
his finger and gets the
information at the
directed
point
through the finger.


This
direct action
and reaction loop
makes the
sensation
much more
realistic.


A haptic map is OK.

Direct a
position

Propose a
stimulation


If there is proper image for tactile stimulation, we
can provide understandable tactile graphic easily.


If we can have the intensity of
each pixel through a finger, we
can not understand the left
image.


If we can have the intensity of
each pixel through a finger, we
can not understand the left
image.


This is a similar action as looking
at the documents through a
telescope.


We can look at any small part of
the document. However, it is
difficult to
understande
.


A tactile
stimulation is
vibration.


A
toutch
-
panel gets an
absolute
position.


1 channel.

Touch panel
display

Transforming
the image

Estimating an
image type

Transforming
to the vibration

Vibration
speaker


Unlike tactile displays, our implementation enables
to share the same display plane with both of visually
disabled persons and sighted persons.


A visually disabled person can point the place on the
display.


A sighted person can gain new information through
his tactile sensation with visual information and audio
information simultaneously.


Presentation of the clickable point.


Confirmation of a click. This is implemented and used.


It transforms the image for visual presentation into
the image for tactile presentation.


The tactile sensation is low resolution.


It has fewer levels.


It only sense at very limited regions.


These features are similar with the situation of weak sight.


The image transformation converts the original image into
understandable image for tactile sensation.


The

user

of

the

proposed

system

is

a

visually

disabled

person
.


There

is

no

method

to

know

the

type

of

an

image

in

the

case

where

some

images

are

send
.


It

is

need

to

estimate

the

image

type
.


On the histogram
of pixel values, we
can decide that the
image is a binary
image, when there
are 2 values.


There are large
correlation among
red, green and blue,
we can decide that
the image is gray
scale image.


There is small
correlation among
colors, we can
decide that the
image is full colored
image.


We

divide

an

image

into

many

parts

of

the

image
.


At

each

partial

image,

we

estimate

the

image

type
.


In

Japan,

there

is

important

to

decide

whether

the

red

mark

exists

or

not
.


Object


Decreasing the number of levels.


Decreasing the resolution.


The tactile sensation can not receive high frequency components.


Method


Binarize


differential


Decrease
resolusion


Color emphasis


A tactile sensation easily
find the existence



Edge between textures


Edge between colors



Touch panel has sensing delay.



Scanning entire display, the delay of the
presentation make difficult to understand.


Moving fast, the motion become to be straight.


It is easy to estimate the future positions.


touch panel display


Absolute position acquisition


Vibration speaker


This is 1 channel tactile stimulator.


PC

UBS

sound source


Displaying an image

Generating tactile stimulation


Text reader


We can feel when the stimulation point is equals to
the place positioning point.


Same finger


Other finger


Sound



channel stimulation is not enough for total
understanding of images
.




channel stimulation has no direction.


It is difficult to trace the edge.




channel stimulation is not enough for total
understanding of images
.




channel stimulation has no direction.


It is difficult to trace the edge.


Multi
-
channel stimulation is needed.


This implementation has not enough image
recognition and image processing.

1.
Maucher
, T.; Meier, K.;
Schemmel
, J.; , "An interactive tactile graphics display,"

Signal Processing and its
Applications, Sixth International, Symposium on. 2001

, vol.1, no., pp.190
-
193 vol.1, 2001

doi
: 10.1109/ISSPA.2001.949809

URL:

http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=949809&isnumber=20554