a cross-field vr case study to treat children with autism...

28
A Cross-Field VR Case Study to Treat Children with Autism Spectrum Disorder Dr. Huai-Sheng (Cage) Huang Fu Jen Catholic University, Taiwan 1

Upload: others

Post on 15-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

A Cross-Field VR Case Study

to Treat Children with

Autism Spectrum Disorder

Dr. Huai-Sheng (Cage) Huang

Fu Jen Catholic University, Taiwan

1

Page 2: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

About Me

• 黃懷陞, Huai-Sheng (Cage) Huang

– Assistant Professor, Department of Information Management,

Fu Jen Catholic University

– Website link

• Honors and Awards

– Speaker of NVIDIA’s GPU Technology Conference (GTC), Silicon Valley, USA,

2018 (video) (News from FJCU)

– Representative of Amazon Web Services Academy in Taiwan, AWS re:Invent,

Las Vegas, USA, 2017

– The Accredited Instructor in Taiwan after Amazon Web Services Academy launched

in Greater China (i.e., Taiwan, Hong Kong and China), Amazon Web Services

Academy, 2017 (News from FJCU)

2

Page 3: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Fu Jen Catholic University (FJCU)

3

Page 4: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Our VR Team

• Third place in the “Hello FJCU! VR competition”, 2017

– Advisor:

• Prof. 黃懷陞 Huai-Sheng (Cage) Huang

– Students:

• 蔡婷憶, 連怡安, 鍾嘉欣, 黃湘婷, 劉羿君

– Co-Advisor:

• Prof. 傅中珮 Chung-Pei Fu

• NVIDIA 王映慈 Gill Wang

– Acknowledgment

• JJCLOUD (極京雲端)

• Mountain Gear Corporation

(President Tsai, 蔡和順董事長)

4

Page 5: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Our VR Team

• First place of DIGI+Talent in the 22th International ICT Innovative

Services Awards, 2017

5

Page 6: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Our VR Team

• GTC 2018 @ Silicon Valley

6

Page 7: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Project

7

Page 8: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Outline

Autism

Motivation Treatment System Future Work

Cross-Field Tools

8

Page 9: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Interdisciplinary Cooperation

9

Page 10: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Interdisciplinary Learning

10

Page 11: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Special Thanks

• FJCU Occupational Therapy & Dr. Fu

11

Page 12: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Development Tools

AWS

DynamoDB

12

Page 13: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Autism Spectrum Disorders

Poor

Comprehension

Abnormal

Behavior

Abnormal

Communication

Narrow

Interests

Video

Preference

Good

Visual Memory 13

Page 14: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Motivation

Time-consuming

Role Play

Setup

Environment

Technology

Applications

14

Page 15: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Traditional Treatment

Source: Foundation for Autistic Children and Adults in Taiwan, FACT. (https://udn.com/news/story/7266/2700378) 15

Page 16: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

VR Treatment

Cognition

Activity of

Daily LifeFine Motor

Social

Interaction

16

Page 17: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

System

Manipulation Destination Greeting

OrderCheck OutFinding SeatRecycling

17

Page 18: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

System

18

Page 19: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

System

19

Page 20: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

System

20

Page 21: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

System

21

Page 22: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

System (Demo Video)

22

A Cross-Field VR Case Study to Treat Children with Autism Spectrum Disorder

Page 23: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Future Work

23

Data

AnalysisModularization Cross-Field

Page 24: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Future Work

• 天主教輔仁大學附設醫院 (2017年9月29日:正式完工啟用)

– 台北捷運輔大站、桃園機場捷運泰山貴和站

– 震撼!輔大醫院挖走33位台大名醫

24

Page 25: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Future Work

• 輔大醫療聯盟 (2018年04月23日)

– 輔大醫院、新光吳火獅紀念醫院、國泰綜合醫院、亞東紀念醫院、恩主公醫院、秀傳醫療體系、童綜合醫院、奇美醫院、義大醫院、新北市立聯合醫院、台北市立聯合醫院、國軍桃園總醫院、天主教耕莘醫院、天主教聖保祿修女會醫院、天主教靈醫會羅東聖母醫院等

– 將提供輔大醫學院學生實習、就業和教職的保證,以及每屆提供5名畢業生至美國史丹佛大學醫學院交換、進修的機會。

25

Page 26: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Future Work

• 首間全聯未來店在輔大開創產學合作新局面

26

Page 27: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Future Work

• Amazon EC2 P3 Instance

– Powerful Performance

– Scalability

27

Page 28: A Cross-Field VR Case Study to Treat Children with Autism ...on-demand.gputechconf.com/gtc-taiwan/2018/pdf/6-3_General...A Cross-Field VR Case Study to Treat Children with Autism Spectrum

Thanks for Listening

28