modernising assessment in teaching and learning · 2016-12-21 · 馬恆熙kevin hang hei ma, the...

17
EdUHK Ranked 2 nd in Asia & 12 th in the World in Education (QS World University Rankings by Subject 2016) 教學評估的現代化發展 Modernising Assessment in Teaching and Learning Magdalena Mo Ching MOK 莫慕貞 Assessment Research Centre & Psychology, FEHD, EdUHK Wen Chung WANG 王文中 Assessment Research Centre & Psychology, FEHD, EdUHK Bo Wah LEUNG 梁寶華 (Today’s Speaker) Cultural & Creative Arts, FLASS, EdUHK Bor-Chen KUO 郭伯臣 National Taichung University of Education, Taiwan

Upload: others

Post on 31-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

EdUHK Ranked 2nd in Asia & 12th in the World in Education (QS World University Rankings by Subject 2016)

教學評估的現代化發展

Modernising Assessment

in Teaching and Learning

Magdalena Mo Ching MOK 莫慕貞Assessment Research Centre & Psychology, FEHD, EdUHK

Wen Chung WANG 王文中Assessment Research Centre & Psychology, FEHD, EdUHK

Bo Wah LEUNG 梁寶華 (Today’s Speaker)

Cultural & Creative Arts, FLASS, EdUHK

Bor-Chen KUO 郭伯臣National Taichung University of Education, Taiwan

Page 2: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

2

Project Aims

1. Promote a strong culture of assessment

of, for, and as learning

• Teacher development

• Partnership & joint projects with school sponsoring bodies, schools, governments, other units at HKIED, other universities

Learning &

Teaching

Assessment

2. Integrate assessment and

Learning &Teaching

Technology

3. Modernise assessment

• Apply latest technology to support assessment reform

Page 3: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

梁寶華 Bo Wah LEUNG, FLASS, The Education University of Hong Kong, Hong Kong

阮兆輝 Siu Fai YUEN BBS, HKIEd Hon. Fellow, Chinese Artists Association of Hong Kong

莫慕貞 Magdalena Mo Ching MOK, The Education University of Hong Kong, Hong Kong

郭伯臣 Bor-Chen KUO, National Taichung University of Education, Taiwan

劉志勇 Zhi-Yong LIU, National Taichung University of Education, Taiwan

朱金鑫 Jinxin ZHU, The Education University of Hong Kong, Hong Kong

鄭重言 Lee CHENG, The Education University of Hong Kong, Hong Kong

林思明 Sze Ming LAM, The Education University of Hong Kong, Hong Kong

陶潔瑩 Kit Ying TAO, The Education University of Hong Kong, Hong Kong

郭嘉榮 Ka Wing KWOK , The Education University of Hong Kong, Hong Kong

吳振瑋 Chun Wai NG, The Education University of Hong Kong, Hong Kong

蔡梓穎 Tsz Wing CHOI, The Education University of Hong Kong, Hong Kong

陳俊賢 Chung Yin CHAN, The Education University of Hong Kong, Hong Kong

Performing Arts of the “SANG" role in Cantonese Opera: Computerised Kinetic

Chain Assessment and Learning System in Cantonese Opera Movement

「粵劇生行身段要訣:電腦化自動評估與學習系統發展計劃」

3

Sponsored by:

Acknowledgement: This research was co-sponsored by Faculty of Liberal Arts and Social Sciences,

and Assessment Research Centre, The Education University of Hong Kong, and Educational

Measurement and Adaptive Learning Center, National Taichung University of Education

Page 4: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

Aims

4

• Breakthrough in the traditional methods (口傳身授) of

teaching and learning of Cantonese opera

• Development of a 3D Computerised Kinetic Chain

Assessment and Learning System (3D肢體感應技術) for

the teaching and learning of body movement in

Cantonese opera

• Modernise traditional Cantonese opera teaching and

learning through computer and multi-media technology

• Further enhance modern Cantonese opera education

Page 5: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

Study Design

• In consultation with Cantonese Opera experts,

develop assessment standards for each movement

• Make use of Kinect systems to capture the 3-D co-

ordinate of human bone skeleton structure

• Compute the angles between skeletal components

• Learner obtains direct feedback on movement

• Assess effect on teaching and learning of Cantonese

Opera5

Page 6: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

6

3D Computerised Automatic Assessment

Of Cantonese Opera (3D-CAACO)

Page 7: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

7http://hk.on.cc/hk/bkn/cnt/news/20151126/bkn-20151126164832308-1126_00822_001.html

3D Computerised Automatic Assessment

Of Cantonese Opera (3D-CAACO)

Page 8: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

Auto-Scoring of Chinese Composition

莫慕貞 Magdalena Mo Ching MOK, FEHD The Education University of Hong Kong, Hong Kong

郭伯臣 Bor-Chen KUO, National Taichung University of Education, Taiwan

張顯達 Hin-Tat CHEUNG, Faculty of Humanities, The Education University of Hong Kong, Hong Kong

白鎧誌 Kai-Chi PAI, National Taichung University of Education, Taiwan

朱金鑫 Jinxin ZHU, The Education University of Hong Kong, Hong Kong

林思明 Sze Ming LAM, The Education University of Hong Kong, Hong Kong

陶潔瑩 Kit Ying TAO, The Education University of Hong Kong, Hong Kong

郭嘉榮 Ka Wing KWOK, The Education University of Hong Kong, Hong Kong

蔡梓穎 Tsz Wing CHOI, The Education University of Hong Kong, Hong Kong

馬恆熙 Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong

Acknowledgement: This research was sponsored by Assessment Research

Centre, The Education University of Hong Kong, and Educational Measurement

and Adaptive Learning Center , National Taichung University of Education

Page 9: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

9

Project Aims

1. Develop a corpus of Chinese compositions of

HK school students

2. Develop a web-based automatic assessment

system for Chinese compositions

3. Enable self-directed learning in Chinese

compositions of students

4. Reduce teacher workload in grading

5. Reduce expenditure on marking in public

examinations

Page 10: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

10

Progress

1. Corpus building

>120 articles from local publishers

2. System development & Testing

About 1,500 writing samples from local schools

>5,000 articles with the highest score in public

examinations (HKALE, HKCEE and HKDSE, from

2001 to 2014)

Page 11: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

11

http://210.240.188.161/ASCC_Website/Index.html

Page 12: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

12

Chinese Composition Assessment: Example Indices

星期日上午,爸爸帶我到沙灘游泳,我覺得很開心。

下水前,爸爸在海邊把水泡充氣,媽媽幫我們塗上太陽油,我心情很興奮。

中午,爸爸帶我游進水中,我躺在水泡上曬太陽,感到十分舒服。

下午,媽媽陪著我在水裡游泳,我感到十分涼快。

兩年前,我、伯娘和姐姐到迪士尼樂園坐火車和看風景。

我們除了坐火車外,還到其他遊戲館玩遊戲。我們累了便到公園內的餐廳進餐,最後還看了漂亮的煙花才回家。

我感覺到既開心又興奮,希望可以快些再到迪士尼樂園遊玩。

ArticleNo. of Words

(詞彙)

No. of Words

(單字)

Connective incidence

Word Concreteness

Type-token ratio (TTR)

1 58 93 0.000000 4.404 0.690

2 60 92 0.020408 4.025 0.767

1

2

Page 13: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

• Provided consultancy to the self-directed learning and flipped classroom action research projects led by the school (joined by 20 other schools)

• Principal & Teacher empowerment: site-based seminar, meetings, professional support on research & publication of journal article and keynote presentations

Lok Sin Tong Wong Chung Ming Secondary School 樂善堂王仲銘中學

13

Support Action Research of Local Schools

• Provided consultancy to TWGH school sponsoring body on Big-Data project. Supported policymaking and implementation on ICT & assessment of TWGHs schools

• Led teachers to present at the TWGH Joint Schools Professional Development Day on “Learning & Teaching Enhancement Through Data Analysis: School data Analysis and Interpretation” to over 2,200 principals, and teachers from 48 TWGH schools

Tung-Wah Group Schools (48 K-, primary & secondary schools) 東華三院

The Salvation Army Shek Wu School 救世軍石湖學校

• Provided consultancy to the school (and 5 partner schools) and informed assessment of social and emotional learning of children with special learning needs

• Provided teacher professional development seminars and workshops on database development and management on social and emotional learning

Page 14: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

14

Professional Development Workshops Participants n

Self-directed Learning for NET teachers (native English

speakers & local curriculum development officers)

Professional officers in

the NET Section of EDB

60

Self-directed Learning Hong Kong primary

school teachers

43

TWGH Joint-School Professional Development Day: Using

data to enhance T&L: Serving Our Children with Data

Science

Principals and teachers

of TWGHs schools, Hong

Kong

2200

TSA Seminar for HKIED Master of Arts for Teaching

English to Speakers of Other Languages

HKIED ENG6358

students

28

TSA District parent seminars (repeated 4 times) Parents of primary &

secondary students

600

Catholic Diocese Teacher Development: New development

and applications of self-directed learning

Principals, senior

teachers of HK Catholic

Diocese schools

213

DSEJ Teacher Development Day: Assessment and self-

directed learning

Macau academics,

researchers, & students

120

EDB Sharing: Talk 1: Latest Development in Concepts and

Tools to Enhance the Quality of Assessment and

Feedback; Talk 2: Using Languages & Mathematics to

demo how to use SP Xpress

EDB staff & teachers

invited

32

TOTAL = 3296

Page 15: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

15

Knowledge Transferred

• Cantonese Opera

• Auto-scoring of Chinese

compositions

• Action Research

• Scholar Exchange

• Seminars , workshops Specialist knowledge,

assessment, ICT

• JAM BOA Vol I & II

• 《二十一世紀大學生學習素養談:香港傑出人士的分享》

• Journal articles

• Invited keynote speeches & conference papers

Publications

• Press conference

• Principal and teacher professional development events

• Reports to schools on joint research

Other

Deliverables• General Research

Funds 2015/16

• Innovation Grant 2015/16

• Corpora (videos, 3D clippings of experts, Chinese compositions)

New

Research

Page 16: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

3. Effectuated evidence-based policymaking and implementation

TWGH school sponsoring body (48 schools): Big Data project

HK Catholic Diocesan schools (98 schools)

EDB: TSA policymaking & implementation as well as new initiatives

Individual schools (e.g. emotional learning assessment of Sp Ed students)

4. Principal and teacher empowerment

Over 3,000 principals, teachers, and parents participated at the seminars

Successful QEF application

Action research – journal articles & conference papers published

5. Enabled effective integration of specialist knowledge, assessment, and ICT

for enhanced T&L

2 online assessment platforms (Cantonese opera; Chinese composition)

6. Prestige and publicity

Press conference (over 180 attendants): local media coverage

Schools recruited to projects

7. Sustainable R&D: Method can be extended to other projects 16

1. Innovative and research based

2. Knowledge Transfer and Collaboration across:

Fields (Cantonese opera, Chinese language, assessment, ICT)

Faculties & units within HKIED (Humanities, FLASS, FEHD)

Universities (HKIED, NTCU, Memphis), schools, school sponsoring bodies,

Chinese Artists Association of HK 八和, EDB, DSEJ

KT, Achievement, and Impact

Page 17: Modernising Assessment in Teaching and Learning · 2016-12-21 · 馬恆熙Kevin Hang Hei MA, The Education University of Hong Kong, Hong Kong Acknowledgement: This research was sponsored

17

Thank you! 謝謝聆聽!

Please send enquiries regarding this presentation to:

Prof. Magdalena Mo Ching MOK,

Assessment Research Centre,

The Education University of Hong Kong,

Hong Kong.

Email: [email protected]