1 measurement measurement rules. 2 measurement components conceptualization conceptualization...

1

MeasurementMeasurement

Measurement RulesMeasurement Rules

2

Measurement Measurement ComponentsComponents

CONCEPTUALIZATIONCONCEPTUALIZATION

NOMINAL DEFINITIONNOMINAL DEFINITION

OPERATIONAL DEFINITIONOPERATIONAL DEFINITION

MEASUREMENT OF THE MEASUREMENT OF THE ATTRIBUTESATTRIBUTES

3

Measurement QualityMeasurement Quality

RELIABILITY – consistencyRELIABILITY – consistency

VALIDITY – “on target”VALIDITY – “on target”

4

ReliabilityReliability

TEST-RETESTTEST-RETEST

SPLIT-HALFSPLIT-HALF

ESTABLISHED MEASURESESTABLISHED MEASURES

RESEARCHER-WORKERRESEARCHER-WORKER

5

ValidityValidity

FACE FACE CRITERION (predictive) - uses CRITERION (predictive) - uses

behaviorbehavior CONSTRUCT - uses theoretical CONSTRUCT - uses theoretical

connectionconnection CONTENT - multiple attributes for CONTENT - multiple attributes for

complex conceptscomplex concepts

6

Rules (Levels) of Rules (Levels) of MeasurementMeasurement

NominalNominal Mutually exclusive and exhaustiveMutually exclusive and exhaustive

OrdinalOrdinal First to last/High to lowFirst to last/High to low

IntervalInterval Known distance between attributesKnown distance between attributes

RatioRatio Absolute zeroAbsolute zero

7

Measurement MatrixMeasurement Matrix

Mutually Mutually Exclusive Exclusive & & ExhaustiveExhaustive

Inherent Inherent order or order or SequenceSequence

Known Known distance distance between between attributesattributes

Absolute Absolute ZeroZero

NominaNominall

XX

OrdinalOrdinal XX XX

IntervalInterval XX XX XX

RatioRatio XX XX XX XX

8

Measurement in the Social Measurement in the Social SciencesSciences

OBSERVATION – the systematic OBSERVATION – the systematic process of recording the behavioral process of recording the behavioral patterns of people, objects, and patterns of people, objects, and occurrences without questioning or occurrences without questioning or communicating with themcommunicating with them

QUESTONING – the systematic process QUESTONING – the systematic process of interacting with people directly of interacting with people directly and/or indirectly in order to have them and/or indirectly in order to have them respond to statements and/or questionsrespond to statements and/or questions

9

Prior QuestionsPrior Questions

SHOULD YOU DO THE STUDY?SHOULD YOU DO THE STUDY? WHO WILL USE THE DATA?WHO WILL USE THE DATA? HOW WILL THE DATA BE USED?HOW WILL THE DATA BE USED? WHAT DATA NEED TO BE WHAT DATA NEED TO BE

COLLECTED?COLLECTED? WHO WILL SUPPLY THE DATA?WHO WILL SUPPLY THE DATA? HOW WILL THE DATA BE HOW WILL THE DATA BE

ANALYZED?ANALYZED?

10

MEASUREMENT IDEASMEASUREMENT IDEAS

INTERVIEW POTENTIAL USERSINTERVIEW POTENTIAL USERS

REVIEW LITERATUREREVIEW LITERATURE

INTERVIEW SAMPLE OF INTERVIEW SAMPLE OF RESPONDENTSRESPONDENTS

BRAIN-STORMINGBRAIN-STORMING

11

What can we observe?What can we observe?

Human behavior and physical Human behavior and physical actions and evidenceactions and evidence

Verbal behaviorVerbal behavior Spatial relations and locationsSpatial relations and locations Temporal patternsTemporal patterns Physical objectsPhysical objects Verbal and pictorial recordsVerbal and pictorial records Expressive behaviorExpressive behavior

12

Trace EvidenceTrace Evidence

ErosionErosion

AccretionAccretion

13

How do we Question?How do we Question?

Directly by researcherDirectly by researcher InterviewInterview

Indirectly by researcherIndirectly by researcher QuestionnaireQuestionnaire

14

CRITERIA FOR CRITERIA FOR QUESTIONSQUESTIONS

CLARITYCLARITY

LENGTHLENGTH

SPECIFICITYSPECIFICITY

UNIDIMENSIONALITYUNIDIMENSIONALITY

WORD CHOICEWORD CHOICE

15

Criteria for Questions Criteria for Questions (cont)(cont)

BIASBIAS

SENSITIVITYSENSITIVITY

REDUNDANCYREDUNDANCY

PURPOSEFULNESSPURPOSEFULNESS

OMNISCIENCEOMNISCIENCE

16

THE RESPONSES: Open-THE RESPONSES: Open-EndedEnded

PILOT STUDIESPILOT STUDIES LESS BIASEDLESS BIASED VARIETY OF RESPONSESVARIETY OF RESPONSES INTRODUCE NEW TOPICSINTRODUCE NEW TOPICS RESPONDENTS “HAVE THEIR SAY”RESPONDENTS “HAVE THEIR SAY” BACKGROUND FOR BACKGROUND FOR

INTERPRETATIONINTERPRETATION ““LIFE & CREDIBILITY”LIFE & CREDIBILITY”

17

THE RESPONSES: Fixed-THE RESPONSES: Fixed-choicechoice

UNIFORM STIMULIUNIFORM STIMULI EASY & QUICK TABULATIONEASY & QUICK TABULATION NOT DEPENDENT UPON WRITING NOT DEPENDENT UPON WRITING

ABILITY OF RESPONDENTSABILITY OF RESPONDENTS LESSEN PROBLEMS OF LESSEN PROBLEMS OF

VOCABULARYVOCABULARY MORE QUESTIONS ASKEDMORE QUESTIONS ASKED EASIER FOR PEOPLE TO COMPLETEEASIER FOR PEOPLE TO COMPLETE

18

What do we do with the What do we do with the data?data?

ReviewReview

RecordRecord

Develop composite measuresDevelop composite measures

19

Composite MeasuresComposite Measures

IndexesIndexes

ScalesScales

TypologiesTypologies

20

Built ScoresBuilt Scores

Index and Scales Index and Scales

Both are Ordinal – scores are relative Both are Ordinal – scores are relative and provide a “ranking” of subjectsand provide a “ranking” of subjects

Both are “Composite” measures – built Both are “Composite” measures – built by “combining values” for several by “combining values” for several measuresmeasures

21

IndexIndex

Index is constructed by Index is constructed by accumulating scores assigned to accumulating scores assigned to individualsindividuals

e.g. “add up” the number of scores on a e.g. “add up” the number of scores on a set of measuresset of measures

i.e. count the number of “yes” i.e. count the number of “yes” responses on a set of measuresresponses on a set of measures

22

Index constructionIndex construction

Select the items – face validity, uni-Select the items – face validity, uni-dimensionality, general or specific, dimensionality, general or specific, variancevariance

Examine the empirical relationships among Examine the empirical relationships among the items – bi-variate, multivariatethe items – bi-variate, multivariate

Assign the scores to the itemsAssign the scores to the items Manage missing data – exclude cases, Manage missing data – exclude cases,

missing as a response, substitutionmissing as a response, substitution Validation – item analysis, external Validation – item analysis, external

validationvalidation

23

ScaleScale

Constructed by assigning “scores” to Constructed by assigning “scores” to patterns of responses – recognizing patterns of responses – recognizing that some items reflect a relatively that some items reflect a relatively “weak degree” of the variable while “weak degree” of the variable while others reflect something “stronger”others reflect something “stronger”

e.g. “women different than men” is e.g. “women different than men” is relatively weaker on a “sexism scale” than relatively weaker on a “sexism scale” than “men should be given preference in jobs “men should be given preference in jobs over women”over women”

24

Scale ConstructionScale Construction

Scales offer more assurance of Scales offer more assurance of ordinality by “getting at” the intensity ordinality by “getting at” the intensity structure among the indicators – there structure among the indicators – there are a number of methods for “scaling”are a number of methods for “scaling” Bogardus Social Distance Scale – (logical Bogardus Social Distance Scale – (logical

structure)structure) Thurstone Scales – (uses judges)Thurstone Scales – (uses judges) Likert Scales – (differences in intensity)Likert Scales – (differences in intensity) Semantic Differential – (opposites)Semantic Differential – (opposites) Guttman Scaling – (“hard vs easy”)Guttman Scaling – (“hard vs easy”)

25

TypologyTypology

Used to summarize the Used to summarize the “intersection” of two or more “intersection” of two or more variables (matrix) thus creating a variables (matrix) thus creating a “new variable”“new variable”

26

Transient Housing Transient Housing TypologyTypology

TEMPORALTEMPORAL

vs vs

CHOICECHOICE

OpportunityOpportunity NecessityNecessity

TemporaryTemporary Temporary Temporary OpportunistsOpportunists

Temporary Temporary NecessitarianNecessitarianss

PermanentPermanent Permanent Permanent OpportunistsOpportunists

Permanent Permanent NecessitaritaNecessitaritansns