1 location based file exchange controlled by speech (lbfe-s) final project (master thesis) by...

21
1 Location Based File Exchange Controlled By Speech (LBFE-S) Final Project (Master Thesis) By Mohammed Marouf [email protected] Supervisor s John A. Sørensen & Michael Lund Project period: 1 st September 2003 - 31 st May 2004 Mohammed Marouf Location Based File Exchange controlled By Speech

Post on 20-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

1

Location Based File Exchange Controlled By Speech

(LBFE-S)

Final Project (Master Thesis)

By

Mohammed [email protected]

Supervisors

John A. Sørensen

&

Michael Lund

Project period:

1st September 2003 - 31st May 2004

Mohammed Marouf

Location Based File Exchange controlled By Speech

2

Schedule Problem Statement LBFE-S Presentation LBFE-S Design and Implementation Test Conclusion and Future Work Demo Questions

Mohammed Marouf

Location Based File Exchange controlled By Speech

3

Problem Statement

Mohammed Marouf

Location Based File Exchange controlled By Speech

Services Informing Service

File Uploading / Downloading Service

4

LBFE-S Presentation

Mohammed Marouf

Location Based File Exchange controlled By Speech

5

LBFE-S Presentation

Mohammed Marouf

Location Based File Exchange controlled By Speech

6

LBFE-S Design and Implementation LBFE-S Architecture Client/Server Communication LBFE-S Data Sources LBFE-S Server Design LBFE-S Client Design Sequence Diagram

Mohammed Marouf

Location Based File Exchange controlled By Speech

7

LBFE-S Architecture

Mohammed Marouf

Location Based File Exchange controlled By Speech

Service

one

Data Source

8

Client/Server Communication (1-3) LBFE-S Internet protocol stack

Mohammed Marouf

Location Based File Exchange controlled By Speech

9

Client/Server Communication (2-3) LBFE-S Protocol

Mohammed Marouf

Location Based File Exchange controlled By Speech

Located+ Position+ course &File names

10

Client/Server Communication (3-3)

Mohammed Marouf

Location Based File Exchange controlled By Speech

Threeway Handshake

LBFE-S Client

LBFE-S Server

Welcome Socket

Connection Socket

Client Socket

Time

Bytes

11

Threading

Mohammed Marouf

Location Based File Exchange controlled By Speech

LBFE-S Server Side

LBFE--S CLient

LBFE --S CLient

Server

Thread

Thread

Thread

Information Files

LBFE-SCLient

Port Number

8000

Re q u e s t

A c c e p tA c cept

A c c e p t

Request

Request

DateTime.java

Position Server

12

LBFE-S Data sources Users.XML Data.XML

Mohammed Marouf

Location Based File Exchange controlled By Speech

<Users><User>

<UserName> marouf</UserName><PassWord> marouf</PassWord>

</User>…

</Users>

<LBFE-S><Info>

<Room> 4.14 </Room><Day> Monday </Day>

<Month> October </Month> <Date> 27 </Date>

<TimeFrom> 9 </TimeFrom><TimeTo> 12 </TimeTo><Course> java </Course><FileName> brixtofte.txt

</FileName></Info>…

</LBFE-S>

13

LBFE-S Server Design Accessing the data sources Authenticate users Position calculation

Mohammed Marouf

Location Based File Exchange controlled By Speech

If

14

LBFE-S Client design Speech Recognizer Speech Synthesizer

Mohammed Marouf

Location Based File Exchange controlled By Speech

15

The Speech Recognizer (1 of 2) The computer listens to the user speech, determines what is said and translates it into

understandable format for the computer.

Mohammed Marouf

Location Based File Exchange controlled By Speech

1. Speaker Dependent/Independent

2. Vocabulary size

Rule Grammar

grammar javax.speech.demo; Header

public <sentence> = Submit | Read me | Ok | Exit Body

16

The Speech Recognizer (2 of 2)

3. Speech Recognizer classes

Mohammed Marouf

Location Based File Exchange controlled By Speech

Isolated words

Connected words

Continuous speech

Spontaneous speech

4 . Quiet/Noisy environment

17

The Speech Synthesizer Computer can speak JSML

Mohammed Marouf

Location Based File Exchange controlled By Speech

18

LBFE-S Sequence diagram

Mohammed Marouf

Location Based File Exchange controlled By Speech

Speech Recognizer

Speech Synthesizer

Client Handler

Server Handler

The Data Stored in XMl files

Recognized Commands

Username+ password + client’s IP address

Validate username and password

results

Get the user’s Position

position

Registered

Spooken output

Room number + date + time

User’s Status

Event (Upload or download)

Upload or download files

User’s Status+ activity name+ filename

Position Server

Status+ Position + Activity name+ File name

19

Test

Mohammed Marouf

Location Based File Exchange controlled By Speech

 System requirement

System analysis

System Design

Acceptance Test

Integration Test

Unit Test

Writing the code

LBFE-S needs

Failure

Success

Success

Success

Success

Failure

Failure

20

Conclusion The accuracy of the EPE can affect the appliaction The accuracy of the speech recognizer was acceptable The results of the system were satisfactory

Mohammed Marouf

Location Based File Exchange controlled By Speech

Future work LBFE-S is easy to extent Upload and download audio and video files Run LBFE-S on PDA Integrate LBFE-S with other systems

21Mohammed Marouf

Location Based File Exchange controlled By Speech

Demo

Thanks

Questions