(발제) extraction of importnat interaxtions in medical interviews using nonverbal...

�"�������������������������������������������������� ��!���������� ��������������������#�� ��������!�����정혜란"�����������

Extraction of Important Interactions in Medical Interviews Using Nonverbal Information

ICMI’07ACM

Yuichi Sawamoto, Yuichi KoyamaYasushi Hirano, Shoji Kajita, Kenji Mase, Kimiko Katsuyama, Kazunobu Yamauchi(Graduate School of Information Science, Nagoya university / Information Technology Center, Nagoya University / School of Nursing, Osaka Prefecture University / Fujita Health University Collegy)

Hyelan. J

ABSTRACT

m�� ®fJ ì�Û� medical interview(Yµ)�s ¨��# ²�Ý §Ï<x¢ ¾¿Û«#

�E¡ ¥F §Ïl Ó@¦&¡ ²�/Ú�Û', ¦ ���s n�� §Ï<x ÕТ Òá ¥o4¥ §Ïl �Ë¢ äq�Ê� �Ý §Ïl Ó@¦&¢ sØÓ Þ | ª'# ¦´N,

�� fA� Ý¡ §Ïl�s ÕТ n��# ac¢ ¹�Û� �á(�«� �% ®v *¦ÏJ �9� ®= *¦ÏC ]�� ktâ#�, multimodal interaction log)

INTRO

- Nve ë«� ³�Û� ë«¥ uç+� )Ý �u}�� �:�Ss ë«-¥o¥ ÃZ$Ŧx� )Ý ��¦ ³�- Ôî medical interview# ë«-¥o¥ ÃZ$Ŧx¦ ¨��# �®�s key process©

- ¦ ���s# medical interview�s# �8 §Ï<x¦ ²�Ý�J `å�# ¦ WÙ- �� C §Ïl ��¢ Ç5ás �� ÃZ$Ŧx¢ ktÝ ��� ��Ñ¡ U �´ ª´N,- ��s# ë«-¥o ÃZ$Ŧx kt� m�� ®fJ ØßÛ# information scienceJ ��Ì

DEFINITION OF PRIMITIVE AND PATTERN

Primitive : A primitive is an element of interaction in dialogues such as and utterance, gaze, or gesture.

Pattern : A pattern is a set of concurrently occurring primitives.

�J 4�, 1 T¥ o;¦ 3�´ §Ï<x¢ â'S ½ 6 primitives, ��s ��| ª# ÕС 64�´

FORMULA

1. Mining of Interaction PatternT(Pat) : the gross occurrence time primitive¥ ÕЦ �� C Á# ��

I(Pat) : a measure of interestI�¦ É|D r�Û# f' ²�Ý ÕЦ:#

FORMULA

2. Expected Gross Occurrence TimeE(Pat) : the expected gross occurrence time of a pattern

1) �u, Û�¥ primitive� _rÛ# ½ ��¢ �p

2) ¨�§ }�� Û�¥ primitive P(Pri)� _rÞ êH

3) pattern P(Pat)� _rÞ êH(ÕÐ¥ V2 primitive� ,L¦:� �®)

FORMULA

3. Comparison to general dialogues¨^§ )é�s# role¥ �k¦ �´N medical interview�s# ‘ë«’� ‘¥o’C �Þ �k¦ Tê6:s ¨^§ )é¥ �� ) ÕЦ _r e.g. Person A gazed at person B , Person B gazed at person A

�pÛ# a�+ 'I� ��[C ¨^§ )é� medical interview# �ká� ߦ 1�´J m�ái C� medical interview�s ²�Ý §Ï<x ÕТ � | ª£

EXPERIMENT & RESULT

1. set-up- ��� ¥�)Ü w\�J |�Û# Ür4� �q ë«- 8�¥ medical interview� 8�¥ ¨^ )éJ |¶- ×� �� : MI=597.0s(� 10k, sd 117.0s), GD=547.3s(sd 90.6s)- collecting data : utterance, gazing, gesture

2. result- 22�¥ ÕТ º� (Im è¡ Ig� 1.00¦q)- �² 14�¥ ÕС Im, Ig V1 1.00 ¦q

- t-testJ Òá medical interview� general dialog¥ ×��¥ ¸¦J ³- q(î ²�Û� �¥\Ý ¸¦J f¦# ÕÐ 4�(P<0.05), �¥\Ý �ä¢ f¦# ÕÐ 5�(P<=0.1), ½ à 9�¥ �¥\Ý ÕТ +¿

DISCUSSION 1

- Pattern A# Yµ� ¥o� "¢ M±Á� ¯�¼J ÀÛR ë«�� PÛ� ª# ��C, ë«� PÛ# ¢ ¦áÞ | ª+D !BÛ� 7Y� ¦? ÕЦ ��

- �J 4�, ë«J ]:g»C {¢ ÖÁR “´�� �¡ qÍ� ´z/´ �M� .���?”

- Pattern E,H,I# Pattern A� m�Û´N gazing¦� gesture� Øß.´ �¡ ÕÐ

- Pattern A� medical interview�s O¦ �§'S Pattern E,H,I# ¨^§ )é�s O¦ f¦# ÕРC ¥o4¡ ë«�� ¦��Þ7 ë«J ]:fR ¯�¼J ÀÛ# �ä¦ ª'# ¢ � | ª£

DISCUSSION 2

- Pattern B# �X? §Ï<x+ ¨��´ �£- ¦ ÕС ¥o� X�� QVÛ� ª¢7(�K�:�s# EMR system¢ o�Û� ª¢7) O¦ f¦# ÕÐ, Patter C# �¦ÄΦ� ¯�¼�¦ Ý·�s ¨a C PÛ# ÕÐ

- ¦? ÕС ¨^§ )é�s# �¥ ¨��´ �# ÕРC ¥o4¡ ¦>Ý ÕÐ¥ ÃZ$Ŧx¦ ¨��#� ±¥á� ß

DISCUSSION 3

- Pattern D# ë«� ¥o¥ ¯�¼J V1 ØßÝ ÕÐ

- ã-¥ -°(synchrony of behavior)� ¨�� - �J 4�, ë«� 1Ò� )Ý ¯�¼J ÛS ¥o# ë«¥ ¦��J ¬ 3� ª R -°Û� ª'# ¢ � C ÙæÛ� �á �¡ ¯�¼J o�

DISCUSSION 4

- Pattern F# medical interview�s Pattern G# ¨^§ )é�s ±C h |ª# ÕРC, ë«# ¥o�� ¦��J Þ 7 ´z C ¥o¥ "¢ ¤�ÛR PÛ# �ä¦ ª£

DISCUSSION 5

CONCLUSION & FUTURE WORK

- ÕÐ kt¢ Òá medical interview�s ²�Ý §Ï<x¢ +¿á - ¦ ��J ì�Û� ¥o4¥ §Ïl �~ äq¢ �)Þ | ª£

- ¦b ���s# �d§ ÕÐN 'G�´N )jk¥ §Ïl# ÕÐ¥ �È�C �v0- '£ ���s# �z§ ÕÐ4�¥ ��� )á ��Þ �®

INTERESTING POINT

- ë«-¥o¥ ÃZ$Ŧx¢ ktÛ#* ��§ �y�� m��§ �yJ Øß�Æ ktÝ - ®v§ �y4¢ _rí|� ´z�� C ®=é >> ÕТ º� - medical interviewJ ¨^§ )é� m�, ¥F +Q§�s _rÛ# )é¥ ±� §Ï<x¢ n�