PowerPoint Presentation

1 (Jeremy)Behavioral Informatics and Interaction Computation Lab (BIIC)http://biic.ee.nthu.edu.tw

Mix Taiwan x :Life in Tech-

THISIS

SUBWAYMAPDataScience

?

?2

MACHINE LEARNINGthe science and engineering of making intelligent machines3

Nave Bayes AlgorithmTransfer learning A-priori Algorithm(Mixture) Gaussian distribution

Random ForestsLogistic Regression

(Deep)Neural NetworksDecision Trees

Nearest NeighborSupport Vector MachineK-Means Algorithm

Linear Regression

Active learning

Domain adaptationSemi-supervised learningReinforcement learningunsupervised learningsupervised learning

deep learning4

https://www.ventureradar.com/5

6

http://versionone.vc/data-not-algorithms-is-key-to-machine-learning-success/http://www.onalytica.com/blog/posts/artificial-intelligence-machine-learning-top-100-influencers-and-brands/6

7

https://venturescannerinsights.wordpress.com/category/artificial-intelligence-2/7

8

Emotion Health CareEducationVoice RecognitionSymptom diagnosisBehavior ActivityImage RecognMedical

IBM Pathway GenomicsDetection of Diabetic Retinopathy in Retinal Fundus Photographs

Customer Behavior

Medical ImagingGenomic Medicine

Education:Myedmatch:https://myedmatch.force.com/MEMHomeGooru:Content analytics that organize and optimize content moduleshttp://about.gooru.org/

Health careGinger.io:https://ginger.io/

Emotion Recogn:pepperMIT LAB():https://techcrunch.com/2016/09/20/this-mit-device-can-tell-if-youre-happy-sad-or-angry-using-wireless-signals/?sr_share=facebookBehavioral Recogn:customer behavior:http://www.strong.io/blog/predicting-customer-behavior-machine-learning-to-identify-paying-customers

Symptom pred:IBM Pathway GenomicsDetection of Diabetic Retinopathy in Retinal Fundus Photographshttp://jamanetwork.com/journals/jama/article-abstract/2588763

Image crcong:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4220564/

Medical:http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=73473318

9 Behavior signal processing

4carry outdata sciencework9

10(Subjective)(Assessment):

. . . . . .

11

: :

:

(NRS)(ADOS)

12

Large-scaleConsistencyParadigm beyond current status quo

13

Seek a window into human mind and traitsthrough engineering approachS. Narayanan and P. G. Georgiou, Behavioral signal processing: Deriving human behavioral informatics from speech and language," Proceedings of the IEEE, vol. 101, no. 5, pp. 12031233, 2013.

13

14BSP INGREDIENTS

BSP 4-STEP APPROACH

BSP INGREDIENTS

15

()

: +

I. II.

III. IV.

, (), () (target label) 15

16(BIIC)BSP . . .

17:

17

18

200/:

?

, ,

: ,

18

19

62.5 ():" "89 ():

19

20

TRAJMBHxy(66)()

Acoustic LLDsFunctionals

(200)()

,

., (..)10, 200ms, , histogram

video frame (15hz)

, (variables)20

21

...

N-gramK-meansAll DocumentsBOWper Document

:

Word2vec

N

21

Machine Learning Module+

22

? 22

23:

1 2

3

,

task (100%?)23

24:

2

110

2

1

10

24

25

?

, 25

26

?

?(Multi-tasking Learning)

26

27BSP INGREDIENTS

BSP INGREDIENTS

28

28

29

30(Taiwan Triage and Acuity Scale, TTAS)

BSP 4-STEP APPROACH

31

32

NRS- : :

33

NRS- : :

33

34(: 0-3, : 4-6, : 7-10)

: :

: : 76%

35BSP INGREDIENTS

BSP INGREDIENTS

36 . . .

500

36

37social-communicative neurodevelopmental disorder

Prevalence: 1 in 68 children (1 in 42 males) diagnosed [CDC2014]ASD: Spectrum disorder due to the extreme heterogeneity

?

38Autism Diagnostic Observation Schedule [Lord 2001]

Subject interacts with a clinician for ~30-45 minutes

Used to help psychologists diagnose autism (current gold standard)

Psychologists are trained using stringent training protocol

28 codes to rate

?

39

(()

40BSP INGREDIENTS

BSP 4-STEP APPROACH

ADOS: Social reciprocity score (B9)

ADOS: social reciprocity score (B9)

42

43

() : 0.81

44 Insight beyond current capability, opportunity now emergesWe can now start imagining the application of this :

(?)

?

More?

45BSP INGREDIENTS

BSP INGREDIENTS

46

BSP INGREDIENTS

, (data scientist)bsp loopinput46

47 Affective Computing Social Signal Processing Paralinguistic Recognition Physiological/Pathological Disorder Recognition/PredictionBSP,

48In-car In-home In-classroom on and on

49Enabling Technologies

Domain Experts Knowledge

Low level descriptorsAcoustic featuresMotion featuresText featuresImage featuresSpeech recognitionFace recognitionAction recognitionDialog act taggingKeyword spottingText processingSentiment AnalysisAffect recognitionSpeaker states and traits

Visual-speech processingInteraction modelingSubjectiveassessmentInternal state & constructNeuro-developmental disorderEvidence-based observational codingIntervention efficacyCoder variability controlDevelopment of coding manualSelf report measure validityCoding mechanismSocial behaviorAffective behaviorCommunicative behaviorDyadic behavior

Enabling technologies + Advancement in the development of construct

49

50

()

()

(): Pattern ()

Contextualize

50

51

52

:

Challenging the status quo/ Pushing scientific boundaryMaking a positive impact

, , 52

53

BiiC lab @ NTHU EEhttp://biic.ee.nthu.edu.tw

THANK YOU . . .

many COLLABORATORS + the entire BIIC lab

2014 53