![Page 1: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/1.jpg)
EllenBaraStolzenberg,Ph.D.AssistantDirector,CIRP
HigherEducationResearchInstituteUniversityofCalifornia,LosAngeles
![Page 2: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/2.jpg)
� Weaccomplishthismissionby:� Workingincooperationwithinstitutionsofhighereducation
� Producinganddisseminatingoriginalresearch
� Providingthetoolsandresourcestoutilizeresearchattheinstitutionallevel
� Trainingresearcherstoadvanceinstitutionalassessmentandscholarshipinhighereducation
� Developingpartnershipswithhighereducationorganizationstopromoteinstitutionalexcellence
HERIMissionStatement“ThemissionoftheHigherEducationResearchInstituteistoinformeducationalpolicyandpromoteinstitutionalimprovementthroughanincreasedunderstandingofhighereducationanditsimpactoncollegestudents.”
![Page 3: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/3.jpg)
TwoDimensionsofHERI
Grant-FundedResearch
• HHMI• HelmsleyTrust• NationalInstitutesofHealth• NationalScienceFoundation
• AnnualStudentSurveys• TriennialFacultySurvey
![Page 4: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/4.jpg)
CIRPStudentSurveys*
CollegeSeniorSurvey
(CSS)
DiverseLearning
Environments(DLE)
YourFirstCollegeYear
(YFCY)
FreshmanSurvey(TFS)
Collegeentry Endof1styear 2ndor3rdyear Senioryear
*FacultySurveyadministeredevery3years
![Page 5: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/5.jpg)
As=nI-E-O
Inputs
Environments
Outputs
Source:AssessmentforExcellence:ThePhilosophyandPracticeofAssessmentandEvaluationinHigherEducation(Astin,1991)
![Page 6: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/6.jpg)
ImportanceofLongitudinalData� Linksurveyscompletedbythesameindividualatdifferentpointsintime
� Onlywaytoeffectivelyassesschange
� Demonstrategrowth
� Studentdevelopment
� Programevaluation
� Collegeimpact
![Page 7: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/7.jpg)
HowCIRPsurveysareusedinlongitudinalassessment?� CIRPdatacanbeusedtoexamineassumptionsaboutthestudentexperienceandhowinstitutionalresourcesrelatetostudentlearning,growth,anddevelopment.
� Institutionscanbenchmarkagainstthemselvesovertimetoexaminetrends,orlongitudinally(usingmultiplesurveys)toassessgrowthanddevelopment.
� InstitutionscancomparetheirperformanceonindividualitemsandrelevantCIRPConstructstopeerinstitutions.
![Page 8: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/8.jpg)
Conceptualiza=onofDiverseLearningEnvironmentsandAssessment� Understandtheexperiencesoftargetpopulationstodiminishinequityandimproveexperiences
� Needtoknowmoreaboutcreatingtheconditionstooptimizeengagementanddesireddiversityoutcomes
� Understandhowtoimproveservicestomeetstudentneeds� Builtonagrowingbodyofresearchwithdiversepopulationsatthecenter
� Reviewed90+previousinstrumentsusedtoassessdiversityandcampusclimate
� Builtonpreviousmodelsoftheenvironment,multiplecontextsofstudentexperience
� Developedasurveythatlinkedclimate(perceptionsandbehaviors)andpractices(whatinstitutionsdo)withstudentoutcomes
![Page 9: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/9.jpg)
DiverseLearningEnvironmentsProject� DLEwasnotjustasurvey.Partoflargermixedmethodsproject� Sitevisits� AdministrationofDLEinstrument� AdvancedresearchmethodsandclimateassessmenttrainingatUCLA
� SimultaneousdevelopmentofMMDLE–Multi-ContextualModelforDiverseLearningEnvironments
� NationalStudentClearinghousedatatostudyretention,combinedwithTFSdata
![Page 10: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/10.jpg)
CampusClimateforDiversity
HistoricalLegacyofInclusion/Exclusion
PsychologicalClimate
(Perceptions)
BehavioralDimension
(InteractionsandPractices)
StructuralDiversity(TheNumbers)
Government/Policy Context Socio-historical Context
(Hurtado, Milem, Clayton-Pedersen, & Allen, 1999)
![Page 11: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/11.jpg)
DLEInstrument
11
� Integratedassessmentofclimate,diversitypractice,andoutcomes
� Inclusiveofdiversesocialidentities� Factors� Longitudinal,orencourageitsuselinkedwithotherstudentdata
� Widelyavailable� Modulestargetingspecifictopics� Newfor2015
![Page 12: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/12.jpg)
Op=onalModules� ClassroomClimate
� TransitiontotheMajor
� IntergroupRelations
� Spirituality(newfor2016)
� ClimateforTransferat2-YearInstitutions
� ClimateforTransferStudentsat4-YearInstitutions
![Page 13: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/13.jpg)
DLEInstrument:Newfor2015� Additionoflimitedsetofquestionsaddressingsexualassault� Students’experienceswith“unwantedsexualcontact”� Follow-upsregardingincapacitation,physicalforce� Disclosurequestions
� Agnosticandatheistoptionsforreligiouspreference
� Additionalrace/ethnicityoptions� Reasonsforconsideringdroppingout
![Page 14: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/14.jpg)
Factors
� Climate� Practices� Outcomes
![Page 15: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/15.jpg)
• Harassment(α=0.917)• Microaggressions(α=0.889)• PositiveCross-RacialInteraction(α=0.882)• SatisfactionwithDiversePerspectivesonCampus(α=0.873)
• InstitutionalCommitmenttoDiversity(α=0.857)
• AcademicValidationintheClassroom(α=0.863)• GeneralInterpersonalValidation(α=0.862)
![Page 16: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/16.jpg)
• CurriculumofInclusion(α=0.854)
• Co-CurricularDiversityActivities(Campus-Facilitated)(α=0.903)
![Page 17: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/17.jpg)
• IntegrationofLearning(α=0.736)• PluralisticOrientation(α=0.787)
• SocialActionEngagement(α=0.799)
• CivicAction(α=0.801)
![Page 18: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/18.jpg)
Administra=on,Data,Reports,&Deliverables
![Page 19: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/19.jpg)
Administra=on� Timing
� Customization� Welcome&Thankyoupages� Invitation&reminders� Logo
� Weboptionsfordisseminatingsurvey
� Additionalquestions� Upto20closed-endedquestions� Upto5open-endedquestions
![Page 20: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/20.jpg)
Data� Accesstopreliminarydataduringadministration
� Finaldatafile
� Confidentialityvs.anonymity
� PersonalIdentifiers
� Mergingdata
![Page 21: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/21.jpg)
Reports&Deliverables� Reports
� InstitutionalProfile� FactorReport� ThemeReport
� Deliverables� PowerPoint� Infographics
� Futureadditionstoreportingpackage� Intergroupcomparisons� Themeinfographicsortargetedhandoutsfordifferentaudiences
![Page 22: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/22.jpg)
Sample:Infographics
![Page 23: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/23.jpg)
2015DLESample� 19,580students
� 26institutions
� 69.4%Female
� 20.8%First-Generation
Race/Ethnicity %NativeAmerican 0.2AsianAmerican 8.4Black/AfricanAmerican 5.7Hawaiian 0.2White,non-Hispanic 48.6Latino/a 20.5Unknown 10.1Twoormore,non-Hispanic 6.2
ClassStanding %Freshman/firstyear 14.4Sophomore/secondyear 23.6Junior/thirdyear 33.7Senior/fourthyear 18.0Fifth-yearsenior+ 10.4
![Page 24: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/24.jpg)
SelectedFindings
71.8
89.682.7
23.3
69.0
28.4
0
10
20
30
40
50
60
70
80
90
100
�Iseemyselfaspartofthecampus
community
Ifasked,Iwouldrecommendthiscollegetoothers
Thiscollegehasalongstandingcommitmentto
diversity
Thiscollegehasalotofracial
tension
Thiscollegeprovidesthefinancial
supportIneedtostayenrolled
Imayhavetochoosebetween
financiallysupportingmyfamilyandgoing
tocollege
%AgreeorStronglyagree
![Page 25: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/25.jpg)
Towhatextenthaveyouexperiencedthefollowingwithstudentsfromaracial/ethnicgroupotherthanyourown?
6.3
12.8
40.3
47.2
0
5
10
15
20
25
30
35
40
45
50
Hadtense,somewhathostile
interactions
Hadguarded,cautiousinteractions
Hadmeaningfulandhonestdiscussionsaboutrace/ethnicrelationsoutsideof
class
Sharedpersonalfeelingsandproblems
%Oftenorveryoften
![Page 26: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/26.jpg)
Haveyoupersonallyexperiencedthefollowingformsofbias/harassment/discrimina:onwhileatthiscollege?
14.1 14.2 14.4 15.117.7
19.9
0
5
10
15
20
25
%Yes
![Page 27: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/27.jpg)
Howmanycourseshaveyoutakenatthiscollegethatincludedmaterials/readingsabout...?
48.956.7
61.369.8
78.7 80.8
0
10
20
30
40
50
60
70
80
90
Disability Sexualorientation
Privilege Gender Socioeconomicclassdifferences
Race/ethnicity
%Oneormore
![Page 28: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/28.jpg)
AssessingthePervasivenessofCollegeSexualAssault
• 11.0%ofwomenreportedunwantedsexualcontactcomparedto4.7%ofmen
• Ratesofunwantedsexualcontactamongfemalesurveyrespondentsforindividualcampuses:3.9%to34.6%
![Page 29: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/29.jpg)
Amongstudentswhoreportedunwantedsexualcontact:� 36.1%reportedtheeventoccurredwhileunabletoprovideconsentduetobeingdrugged,drunk,orotherwiseincapacitated
� 19.0%reportedtheeventinvolvedtheuseorthethreattousephysicalforce
� 57.5%indicatedtheallegedassailanthadanaffiliationwithcampus,and16.7%wereunsure
� 18.6%didn’ttellanyone,11.9%toldacounselorortherapist,5.0%toldacampusadministrator,3.9%toldcampuspolice,2.4%toldlocallawenforcement
� 77.7%toldafriend,15.2%toldaparent/guardian
![Page 30: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/30.jpg)
UsingtheData:3Perspec=ves� Localcampusresearch
� Programreviewandevaluation� Mergewithinstitutionaldata� Institutionaleffectiveness� Campusclimate� Learningoutcomes� Accreditation
� Institutional-levelComparisons� National� Comparisongroups� Institution-selectedpeers
� HERIresearchusingnationaldata� Peer-reviewedjournals� Monographs� Presentations� BriefReports
![Page 31: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/31.jpg)
NextStepsfortheDLE� Releaseof2015Infographic&Brief
� Continuetoanalyze2015data� Questionskips� Surveydropoff� Examinationacrossdemographics
� Newfor2016� Socialidentityquestionaddedtothecore� Addeddistinctionbetweenunwantedsexualcontactandsexualassault� Timing,officialcomplaint,satisfactionwithoutcome
� Spiritualitymodule
![Page 32: Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional effectiveness Campus](https://reader035.vdocuments.pub/reader035/viewer/2022071216/60482b0c770b951a3b059823/html5/thumbnails/32.jpg)
ContactInforma=onEllenBaraStolzenberg,PhD
AssistantDirector,CIRPUCLAHigherEducationResearchInstitute
(310)[email protected]