1 measurement measurement rules. 2 measurement components conceptualization conceptualization...

26
1 Measurement Measurement Measurement Rules Measurement Rules

Post on 21-Dec-2015

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

1

MeasurementMeasurement

Measurement RulesMeasurement Rules

Page 2: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

2

Measurement Measurement ComponentsComponents

CONCEPTUALIZATIONCONCEPTUALIZATION

NOMINAL DEFINITIONNOMINAL DEFINITION

OPERATIONAL DEFINITIONOPERATIONAL DEFINITION

MEASUREMENT OF THE MEASUREMENT OF THE ATTRIBUTESATTRIBUTES

Page 3: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

3

Measurement QualityMeasurement Quality

RELIABILITY – consistencyRELIABILITY – consistency

VALIDITY – “on target”VALIDITY – “on target”

Page 4: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

4

ReliabilityReliability

TEST-RETESTTEST-RETEST

SPLIT-HALFSPLIT-HALF

ESTABLISHED MEASURESESTABLISHED MEASURES

RESEARCHER-WORKERRESEARCHER-WORKER

Page 5: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

5

ValidityValidity

FACE FACE CRITERION (predictive) - uses CRITERION (predictive) - uses

behaviorbehavior CONSTRUCT - uses theoretical CONSTRUCT - uses theoretical

connectionconnection CONTENT - multiple attributes for CONTENT - multiple attributes for

complex conceptscomplex concepts

Page 6: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

6

Rules (Levels) of Rules (Levels) of MeasurementMeasurement

NominalNominal Mutually exclusive and exhaustiveMutually exclusive and exhaustive

OrdinalOrdinal First to last/High to lowFirst to last/High to low

IntervalInterval Known distance between attributesKnown distance between attributes

RatioRatio Absolute zeroAbsolute zero

Page 7: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

7

Measurement MatrixMeasurement Matrix

Mutually Mutually Exclusive Exclusive & & ExhaustiveExhaustive

Inherent Inherent order or order or SequenceSequence

Known Known distance distance between between attributesattributes

Absolute Absolute ZeroZero

NominaNominall

XX

OrdinalOrdinal XX XX

IntervalInterval XX XX XX

RatioRatio XX XX XX XX

Page 8: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

8

Measurement in the Social Measurement in the Social SciencesSciences

OBSERVATION – the systematic OBSERVATION – the systematic process of recording the behavioral process of recording the behavioral patterns of people, objects, and patterns of people, objects, and occurrences without questioning or occurrences without questioning or communicating with themcommunicating with them

QUESTONING – the systematic process QUESTONING – the systematic process of interacting with people directly of interacting with people directly and/or indirectly in order to have them and/or indirectly in order to have them respond to statements and/or questionsrespond to statements and/or questions

Page 9: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

9

Prior QuestionsPrior Questions

SHOULD YOU DO THE STUDY?SHOULD YOU DO THE STUDY? WHO WILL USE THE DATA?WHO WILL USE THE DATA? HOW WILL THE DATA BE USED?HOW WILL THE DATA BE USED? WHAT DATA NEED TO BE WHAT DATA NEED TO BE

COLLECTED?COLLECTED? WHO WILL SUPPLY THE DATA?WHO WILL SUPPLY THE DATA? HOW WILL THE DATA BE HOW WILL THE DATA BE

ANALYZED?ANALYZED?

Page 10: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

10

MEASUREMENT IDEASMEASUREMENT IDEAS

INTERVIEW POTENTIAL USERSINTERVIEW POTENTIAL USERS

REVIEW LITERATUREREVIEW LITERATURE

INTERVIEW SAMPLE OF INTERVIEW SAMPLE OF RESPONDENTSRESPONDENTS

BRAIN-STORMINGBRAIN-STORMING

Page 11: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

11

What can we observe?What can we observe?

Human behavior and physical Human behavior and physical actions and evidenceactions and evidence

Verbal behaviorVerbal behavior Spatial relations and locationsSpatial relations and locations Temporal patternsTemporal patterns Physical objectsPhysical objects Verbal and pictorial recordsVerbal and pictorial records Expressive behaviorExpressive behavior

Page 12: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

12

Trace EvidenceTrace Evidence

ErosionErosion

AccretionAccretion

Page 13: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

13

How do we Question?How do we Question?

Directly by researcherDirectly by researcher InterviewInterview

Indirectly by researcherIndirectly by researcher QuestionnaireQuestionnaire

Page 14: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

14

CRITERIA FOR CRITERIA FOR QUESTIONSQUESTIONS

CLARITYCLARITY

LENGTHLENGTH

SPECIFICITYSPECIFICITY

UNIDIMENSIONALITYUNIDIMENSIONALITY

WORD CHOICEWORD CHOICE

Page 15: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

15

Criteria for Questions Criteria for Questions (cont)(cont)

BIASBIAS

SENSITIVITYSENSITIVITY

REDUNDANCYREDUNDANCY

PURPOSEFULNESSPURPOSEFULNESS

OMNISCIENCEOMNISCIENCE

Page 16: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

16

THE RESPONSES: Open-THE RESPONSES: Open-EndedEnded

PILOT STUDIESPILOT STUDIES LESS BIASEDLESS BIASED VARIETY OF RESPONSESVARIETY OF RESPONSES INTRODUCE NEW TOPICSINTRODUCE NEW TOPICS RESPONDENTS “HAVE THEIR SAY”RESPONDENTS “HAVE THEIR SAY” BACKGROUND FOR BACKGROUND FOR

INTERPRETATIONINTERPRETATION ““LIFE & CREDIBILITY”LIFE & CREDIBILITY”

Page 17: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

17

THE RESPONSES: Fixed-THE RESPONSES: Fixed-choicechoice

UNIFORM STIMULIUNIFORM STIMULI EASY & QUICK TABULATIONEASY & QUICK TABULATION NOT DEPENDENT UPON WRITING NOT DEPENDENT UPON WRITING

ABILITY OF RESPONDENTSABILITY OF RESPONDENTS LESSEN PROBLEMS OF LESSEN PROBLEMS OF

VOCABULARYVOCABULARY MORE QUESTIONS ASKEDMORE QUESTIONS ASKED EASIER FOR PEOPLE TO COMPLETEEASIER FOR PEOPLE TO COMPLETE

Page 18: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

18

What do we do with the What do we do with the data?data?

ReviewReview

RecordRecord

Develop composite measuresDevelop composite measures

Page 19: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

19

Composite MeasuresComposite Measures

IndexesIndexes

ScalesScales

TypologiesTypologies

Page 20: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

20

Built ScoresBuilt Scores

Index and Scales Index and Scales

Both are Ordinal – scores are relative Both are Ordinal – scores are relative and provide a “ranking” of subjectsand provide a “ranking” of subjects

Both are “Composite” measures – built Both are “Composite” measures – built by “combining values” for several by “combining values” for several measuresmeasures

Page 21: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

21

IndexIndex

Index is constructed by Index is constructed by accumulating scores assigned to accumulating scores assigned to individualsindividuals

e.g. “add up” the number of scores on a e.g. “add up” the number of scores on a set of measuresset of measures

i.e. count the number of “yes” i.e. count the number of “yes” responses on a set of measuresresponses on a set of measures

Page 22: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

22

Index constructionIndex construction

Select the items – face validity, uni-Select the items – face validity, uni-dimensionality, general or specific, dimensionality, general or specific, variancevariance

Examine the empirical relationships among Examine the empirical relationships among the items – bi-variate, multivariatethe items – bi-variate, multivariate

Assign the scores to the itemsAssign the scores to the items Manage missing data – exclude cases, Manage missing data – exclude cases,

missing as a response, substitutionmissing as a response, substitution Validation – item analysis, external Validation – item analysis, external

validationvalidation

Page 23: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

23

ScaleScale

Constructed by assigning “scores” to Constructed by assigning “scores” to patterns of responses – recognizing patterns of responses – recognizing that some items reflect a relatively that some items reflect a relatively “weak degree” of the variable while “weak degree” of the variable while others reflect something “stronger”others reflect something “stronger”

e.g. “women different than men” is e.g. “women different than men” is relatively weaker on a “sexism scale” than relatively weaker on a “sexism scale” than “men should be given preference in jobs “men should be given preference in jobs over women”over women”

Page 24: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

24

Scale ConstructionScale Construction

Scales offer more assurance of Scales offer more assurance of ordinality by “getting at” the intensity ordinality by “getting at” the intensity structure among the indicators – there structure among the indicators – there are a number of methods for “scaling”are a number of methods for “scaling” Bogardus Social Distance Scale – (logical Bogardus Social Distance Scale – (logical

structure)structure) Thurstone Scales – (uses judges)Thurstone Scales – (uses judges) Likert Scales – (differences in intensity)Likert Scales – (differences in intensity) Semantic Differential – (opposites)Semantic Differential – (opposites) Guttman Scaling – (“hard vs easy”)Guttman Scaling – (“hard vs easy”)

Page 25: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

25

TypologyTypology

Used to summarize the Used to summarize the “intersection” of two or more “intersection” of two or more variables (matrix) thus creating a variables (matrix) thus creating a “new variable”“new variable”

Page 26: 1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION

26

Transient Housing Transient Housing TypologyTypology

TEMPORALTEMPORAL

vs vs

CHOICECHOICE

OpportunityOpportunity NecessityNecessity

TemporaryTemporary Temporary Temporary OpportunistsOpportunists

Temporary Temporary NecessitarianNecessitarianss

PermanentPermanent Permanent Permanent OpportunistsOpportunists

Permanent Permanent NecessitaritaNecessitaritansns