hiroshi ishiguro - nedo.go.jp · interactive robots and our future society hiroshi ishiguro...

Interactive Robots and Our Future Society

HiroshiISHIGURO

Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro LaboratoriesResearch Director of JST ERATO Ishiguro Symbiotic HRI Project

ishiguro@sys.es.osaka-u.ac.jpwww.is.sys.es.osaka-u.ac.jp, www.geminoid.jp．

Interactive Robots and Our Future Society

HiroshiISHIGURO

Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro LaboratoriesResearch Director of JST ERATO Ishiguro Symbiotic HRI Project

ishiguro@sys.es.osaka-u.ac.jpwww.is.sys.es.osaka-u.ac.jp, www.geminoid.jp．

1

2

3

RobotSociety

Android

Android

Human

4

Why do we use humanoids?

Humans have brains that recognize humansThe ideal interface for humans are humans.

5

Robotics for Understanding Humans

Robotics for understanding humans6

Develop humanlike robots based on knowledge in cognitive science.Verify hypotheses in cognitive science by using the robots.

Science

Engineering

Pattern Recognition

Mechanical EngineeringMechanical Engineering

Hypothesis & verification

Integration of Science and Technology

SystemsEngineering

SystemsEngineering

Neuroscience

Psychology

Robotics

Cognitivescience

Cognitivescience

8

9

Practical Interactive Robots

10

11

12

The future societysupported by humanoids & androids

Elderly care

Public places Learning

Department stores Stations

Humanoids

13

Androids withHumanlike Emotional

Expressions

14

Android in the show window

15

Android as an idol singer

16

Android theaterwith Oriza Hirata

17

Movie “Sayonara (Goodbye)”

18

We feel the humanlike hearts /minds of the android, but it is a simple computer program.

What is heart/mind?What is heart/mind?

20

22

Extension of Human Presence with Androids

Ishiguro’s android Geminoid23

26Android of a great literary figure

30

Androids withconversational functions

31

Geminoid

Inte

rnet

Operator

32

Autonomous conversational android

Inte

rnet

Operator

Computer

33

Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson

Story-based approachStories written by writersComplex conversation for limited topics

34

Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson

Story-based approachStories written by writersComplex conversation for limited topics

35

36

Conversational Autonomous Androids

NTT LaboratoriesOsaka University and ATR

Microphone array by NTTVoice recognition by NTTChatbot by NTTAndroid by Osak Univ.Lip and head movements by ATR

39

40

Casual discussion dialogue system with NTT

Sushi is better than

Ramen.

Sushi is healthy.

Ramen has more varieties.

You can eat fish, which is

good for health

Sushi actually has high calories.

＋

＋ ー

ー

＋

[Walton, 2003]

Casual discussion dialogue system with NTT

44

Deep discussion dialogue system with NTT

Mechanismof deep discussion

45

(2) Voice Recognition(Words, Positive/Negative)

(2) Voice Recognition(Words, Positive/Negative)

QuestionAnswerBack

ChannelHuman

AnswerNext topic

ClaimGroundWarrant

46

Toulmin model of argument

ClaimClaim Ground(or Data)

Ground(or Data)

WarrantWarrant

Harry was born in Bermuda.Harry must be a British subject.

A man born in Bermuda will be a British subject.

48

Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson

Story-based approachStories written by writersComplex conversation for limited topics

49

JST ERATO ISHIGUROSymbiotic Human Robot Interaction

Project2014-2020

50

Android that hasintensions and desires

BehaviorBehavior

IntentionIntention

DesireDesire

BehaviorBehaviorBehaviorBehaviorBehaviorBehavior

BehaviorBehavior

BehaviorBehaviorBehaviorBehavior

BehaviorBehavior

BehaviorBehavior

BehaviorBehavior

BehaviorBehaviorBehaviorBehavior

BehaviorBehaviorBehaviorBehaviorBehaviorBehavior

BehaviorBehavior

BehaviorBehaviorBehaviorBehavior

IntentionIntention IntentionIntention

DesireDesire DesireDesire

IntentionIntention IntentionIntention

IntentionIntention

Speech and gesture recognition

Speech and gesture recognition

Utterance and behavior generation

Utterance and behavior generation

Hierarchical models of utterance and behavior generation

BehaviorBehavior

IntentionIntention

DesireDesire

Robot

51

ISHIKI System

52

Interaction Composer

53

54

55

56

57