comunicazione non verbale: computazione affettiva -...
TRANSCRIPT
Comunicazione non verbale:
computazione affettiva
Corso di Interazione uomo-macchina II
Prof. Giuseppe Boccignone
Dipartimento di Scienze dell’Informazione
Università di Milano
[email protected]://homes.dsi.unimi.it/~boccignone/l
Ipotesi di lavoro: interazione fra organismi
metabolismo
emozioni
motivazioni
azione
percezione
riflessione
metabolismo
emozioni
motivazioni
azione
percezione
riflessione
verbalenon verbale
ambiente
Riconoscere emozioni
metabolismo
emozioni
motivazioni
azione
percezione
riflessione
ambiente
PROCESSI
COSTITUTIVI
PROCESSI
INTERATTIVI
AUTONOMIA /
LIVELLI DI CONTROLLO
CONTROLLO
VISCERALE
REGOLAZIONE
OMEOSTATICA
CONTROLLO
EMOTIVO
CONTROLLO
RIFLESSIVO /
COGNITIVO
Goals
interni
Goals
esterni
confine del corpo
situato nell’ambiente
Riconoscere emozioni
A. Vinciarelli, M. Pantic, H. Bourlard, Social Signal Processing: Survey of an Emerging Domain,Image and Vision Computing (2008)
Emotional expression
A. Vinciarelli, M. Pantic, H. Bourlard, Social Signal Processing: Survey of an Emerging Domain,Image and Vision Computing (2008)
Emotional expression
Emotional expression
• Approcci possibili:
• Discrete (Ekman) vs. Dimensional (Russell)
• AU-based (Ekman) vs. holistic
Riconoscere emozioni da espressioni facciali
Paradigma dominante
• Approcci possibili:
• Discrete (Ekman) vs. Dimensional (Russell)
• AU-based (Ekman) vs. holistic
Riconoscere emozioni da espressioni facciali
Paradigma dominante Approcci robusti
• Approcci possibili:
• Discrete (Ekman) vs. Dimensional (Russell)
• AU-based (Ekman) vs. holistic
Riconoscere emozioni da espressioni facciali
Meno consueti
Usati soprattutto nella simulazione virtuali
Analisi di emozioni in musica o nel parlato
Riconoscere emozioni da espressioni facciali
//http://www.visual-recognition.nl/index.html
Riconoscere emozioni da espressioni facciali
Expression vs identity
//A.J. Calder et al. : Vision Research 41 (2001)
Expression vs identity
//A.J. Calder et al. : Vision Research 41 (2001)
Expression vs identity
//A.J. Calder et al. : Vision Research 41 (2001)
Expression vs identity
//A.J. Calder et al. : Vision Research 41 (2001)
Expression vs identity
//A.J. Calder et al. : Vision Research 41 (2001)
Schema generale di un sistema per AU detection
Riconoscere emozioni da espressioni facciali
//Bartlett et al.
Riconoscere emozioni da espressioni facciali
//Bartlett et al.
Riconoscere emozioni da espressioni facciali
//Bartlett et al.
Unified Probabilistic Framework
for Spontaneous Facial Action Modeling
• Tong et al (2010)
Unified Probabilistic Framework
for Spontaneous Facial Action Modeling
• Tong et al (2010)
Mind-Reading Machines:
Automated Inference of Complex Mental States
by Rana Ayman el Kaliouby
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Mind-Reading Machines:
Automated Inference of Complex Mental States
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Active and Dynamic Information Fusion
for Facial Expression Understanding
• Zhang & Ji
Dimensional approach via Gabor wavelets
• Lyons et al.
Dimensional approach via Gabor wavelets
• Lyons et al.
• Gabor and human similarity data was
analyzed usingnon-metric
multidimensional scaling (nMDS) using
theALSCAL algorithm [13].
• nMDS embeds points in a euclidean
space in such a way that the distances
between points preserves the rank order
of the dissimilarity values betweenthose
points.
• it was found that two dimensions
provide an adequate embedding of the
similarity data
Dimensional approach via Gabor wavelets
• Lyons et al.
• Gabor and human similarity data was
analyzed usingnon-metric
multidimensional scaling (nMDS) using
theALSCAL algorithm [13].
• nMDS embeds points in a euclidean
space in such a way that the distances
between points preserves the rank order
of the dissimilarity values betweenthose
points.
• it was found that two dimensions
provide an adequate embedding of the
similarity data
Dimensional approach via Gabor wavelets
Emotion by dynamical simulation
• Essa & Pentland (1997): We describe a computer vision system for observing
facial motion by using an optimal estimation optical flow method coupled with
geometric, physical and motion-based dynamic models describing the facial
structure. Our method produces a reliable parametric representation of the
face’s independent muscle action groups, as well as an accurate estimate of
facial motion.
• Essa & Pentland (1997):
Emotion by dynamical simulation
• Essa & Pentland (1997):
Emotion by dynamical simulation
• Essa & Pentland (1997):
Emotion by dynamical simulation
• Essa & Pentland (1997):
Emotion by dynamical simulation
• Essa & Pentland (1997):
Emotion by dynamical simulation
Reconstruction of Facial Expressions in Embodied
Systems
• Karl Grammer & Elisabeth Oberzaucher
Reconstruction of Facial Expressions in Embodied
Systems
• Karl Grammer & Elisabeth Oberzaucher
Reconstruction of Facial Expressions in Embodied
Systems
• Karl Grammer & Elisabeth Oberzaucher
Reconstruction of Facial Expressions in Embodied
Systems
• Karl Grammer & Elisabeth Oberzaucher
• The activation of single AUs in a
pleasure and arousal space. Note that
these
• distributions are different for different
Action Units.
Reconstruction of Facial Expressions in Embodied
Systems
• Karl Grammer & Elisabeth Oberzaucher
Reconstruction of Facial Expressions in Embodied
Systems
• Karl Grammer & Elisabeth Oberzaucher
Sociable robots
• Kismet
Sociable robots
• Kismet
Sociable robots
• Kismet
Sociable robots
• Kismet
Sociable robots
• Kismet
Sociable robots
• Kismet
Sociable robots
• Kismet