workshop 2. linguistic tests
DESCRIPTION
TRANSCRIPT
![Page 1: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/1.jpg)
Linguistic testsWorkshop 2
![Page 2: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/2.jpg)
Types of Tasks
Naturalistic production tasks. Elicited Production Tasks Comprehension Tasks: Explicit Measures Comprehension Tasks: Implicit Measures Online Tasks
![Page 3: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/3.jpg)
NATURALISTIC PRODUCTION TASKS
Naturalistic speech Naturalistic writing
![Page 4: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/4.jpg)
WHAT THEY MEASURE
Production (oral or written)Performance (don’t tap into
competence very much)Primarily implicit knowledge
![Page 5: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/5.jpg)
WHAT THEY STUDY
Lexical knowledgeInflectional morphology (use
of past tense morphology)Basic syntax (word order)In classroom research
![Page 6: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/6.jpg)
Pros
Easy to conductClosest way to measuring
language as it is actually used.
![Page 7: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/7.jpg)
Cons
Time-consuming (create and analyze transcripts)
No control over production for the experimenter
Low proficiency L2 learners may be reluctant to produce anything
Absence of evidence is not evidence of absence.
![Page 8: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/8.jpg)
ELICITED PRODUCTION TASKS
Eliciting entire speech/writing samples
Eliciting individual words/phrases
![Page 9: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/9.jpg)
WHAT THEY MEASURE
Production (oral or written)Performance (tap into
competence)More explicit knowledge than
the naturalistic tasks
![Page 10: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/10.jpg)
WHAT THEY STUDY
Lexical knowledge Inflectional morphology (have
to supply the right form of a verb)
Semantics of closed-class words (use of the vs. a)
In classroom research
![Page 11: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/11.jpg)
Pros
More control over type of production than with naturalistic production
Can target specific words/phrases
![Page 12: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/12.jpg)
Cons
Still a lot of transcribingMay be testing explicit rather
than implicit knowledge (with word/phrase elicitation)
Not appropriate for use with children or low literacy adults (most experimenter controlled type of elicitation is written)
![Page 13: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/13.jpg)
COMPREHENSION TASKS: EXPLICIT MEASURES
Grammaticality JudgementsAcceptability JudgementsPreference JudgementsSentence Conjunction
Judgements
![Page 14: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/14.jpg)
What they measure
ComprehensionPerformance (tapping directly
into competence)Very explicit knowledge
![Page 15: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/15.jpg)
What they study
Complex sentence structure (that are not often used spontaneously)
Inflectional morphologySemantic appropriateness
(whether one grammatical sentence is appropriate in the context of another)
![Page 16: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/16.jpg)
Pros
Can test just about any kind of grammatical construction.
Straightforward: testing exactly what we want to know.
Easy to analyze the data.
![Page 17: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/17.jpg)
Cons
Tests highly explicit knowledgeL2 learners are often unsure
about their judgementsInappropriate for use with
children and low literacy adults (written format)
![Page 18: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/18.jpg)
COMPREHENSION TASKS: IMPLICIT MEASURES
Truth-value judgement tasksPicture-matching/ picture -
selection tasks
![Page 19: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/19.jpg)
What they measure
ComprehensionPerformance (tapping directly
into competence)Implicit knowledge
![Page 20: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/20.jpg)
What they study
Interpretation of pronouns and reflexives
Aspectual interpretationGeneric vs. Specific
interpretation
![Page 21: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/21.jpg)
Pros
No focus on grammar – test of implicit knowledge
Appropriate for children and low literacy adults – use of pictures na doral stories
![Page 22: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/22.jpg)
Cons
Can only be used for linguistic knowledge at the syntax-semantics interface – constrained application
Tests are time consuming and difficult to construct
Have to control for many factors
![Page 23: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/23.jpg)
Online Tasks
Self-pased reading / listening
![Page 24: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/24.jpg)
What they measure
processingperformance with implications
for competenceimplicit knowledge – subject
does not know what is being tested
![Page 25: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/25.jpg)
What they study
Whether some sentence types are more difficult to process then others (active vs. passive, subject questions vs. object questions)
How speakers process ambiguous
![Page 26: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/26.jpg)
Pros
Test implicit knowledgeGet data about language use
in real time
![Page 27: Workshop 2. linguistic tests](https://reader035.vdocuments.pub/reader035/viewer/2022081414/54be8e5d4a795953268b45bd/html5/thumbnails/27.jpg)
Cons
More costly and time consuming than offline tasks
Highly constrained applicationThe connection from
reaction/reading times to conclusions about language relies on certain assumptions