self organizing maps and bit signature: a study applied on signal language recognition

Intelligent Database Systems Lab

國立雲林科技大學National Yunlin University of Science and Technology

1

Self Organizing Maps and Bit Signature:a study applied on Signal Language Recognition

Presenter : Wei-Hao Huang 　Authors : Marrony N. Neris, Alexandre J. Silva, Sarajane M. Peres, Franklin C. Flores

IJCNN, 2008

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

2

Outlines Motivation Objectives Methodology Experiments Conclusions Comments

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

3

Motivation· In Brazil1 verified that 3.3% of 169,872,856

Brazilians are deaf or are people that claim to have great difficulty to listen.

· Assistive technologies are destined to make easy the life of disabled people.

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.Objectives

4

· To propose an artificial neural network application and a style of image representation on the LIBRAS (Brazilian Signal Language) recognition problem.

Process O

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

5

Methodology

Bit Signature

Unified Distance Matrix (U-Matrix)

Self Organizing Map

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.Bit Signature

6

Horizontal bit signature Vertical bit signature

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.Unified Distance Matrix (U-Matrix)

7

SOM map

Three clusters

Process U-Matrix

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

8

SOM training process

U-matrix

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

9

SOM map labeling process

U-matrix

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

10

SOM testing process

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.Experiments

11

26 LIBRAS signals 46 LIBRAS signals

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

12

Conclusions· The generalization demanded by this situation is really

hard, but this approach is able to realize a good work.

· The future work is to improve recognizer performance.

Intelligent Database Systems Lab

N.Y.U.S.T.

I. M.

13

Comments· Advantages

─ Visual analysis· Applications

─ SOM