self organizing maps and bit signature: a study applied on signal language recognition

Intelligent Database Systems Lab

國立雲林科技大學National Yunlin University of Science and Technology

1

Self Organizing Maps and Bit Signature:a study applied on Signal Language Recognition

Presenter : Wei-Hao Huang 　Authors : Marrony N. Neris, Alexandre J. Silva, Sarajane M. Peres, Franklin C. Flores

IJCNN, 2008


N.Y.U.S.T.

I. M.

2

Outlines Motivation Objectives Methodology Experiments Conclusions Comments


N.Y.U.S.T.

I. M.

3

Motivation· In Brazil1 verified that 3.3% of 169,872,856

Brazilians are deaf or are people that claim to have great difficulty to listen.

· Assistive technologies are destined to make easy the life of disabled people.


N.Y.U.S.T.

I. M.Objectives

4

· To propose an artificial neural network application and a style of image representation on the LIBRAS (Brazilian Signal Language) recognition problem.

Process O


N.Y.U.S.T.

I. M.

5

Methodology

Bit Signature

Unified Distance Matrix (U-Matrix)

Self Organizing Map


N.Y.U.S.T.

I. M.Bit Signature

6

Horizontal bit signature Vertical bit signature


N.Y.U.S.T.

I. M.Unified Distance Matrix (U-Matrix)

7

SOM map

Three clusters

Process U-Matrix


N.Y.U.S.T.

I. M.

8

SOM training process

U-matrix


N.Y.U.S.T.

I. M.

9

SOM map labeling process

U-matrix


N.Y.U.S.T.

I. M.

10

SOM testing process


N.Y.U.S.T.

I. M.Experiments

11

26 LIBRAS signals 46 LIBRAS signals


N.Y.U.S.T.

I. M.

12

Conclusions· The generalization demanded by this situation is really

hard, but this approach is able to realize a good work.

· The future work is to improve recognizer performance.


N.Y.U.S.T.

I. M.

13

Comments· Advantages

─ Visual analysis· Applications

─ SOM

self organizing maps and bit signature: a study applied on signal language recognition

Documents