can motivational videos improve agency and self-efficacy: evidence from a nairobi slum
TRANSCRIPT
Can motivational videos improve agency and self-efficacy:
Evidence from a Nairobi slumNada Eissa, James Habyarimana and William
JackGeorgetown University
University of Arizona Development Workshop on Mind, Society and Behavior
Tucson, April 17, 2015
The challenges of slum life• Unemployment
– Lack of opportunities
• Inadequate public good provision– Waste management– Security– Other infrastructure
• Low levels and quality of public service provision– Sanitation– Education– Police
All symptoms of a low-trust environment
Research questions• Can some of these problems be addressed by more
active participation by slum-dwellers?
– Entrepreneurship
– Collective action
– Monitoring and enforcement
• Can subtle messages lead to behavior change?
• Or are direct instructions more effective?
Context: Sanitation in the Kenyan Constitution
• Article 43. (1) Every person has the right—
(a) to the highest attainable standard of health, which includes the right to health care services, including reproductive health care;
(b) to accessible and adequate housing, and to reasonable standards of sanitation;
(c) to be free from hunger, and to have adequate food of acceptable quality;
(d) to clean and safe water in adequate quantities;
Sanitation mobilization campaign
• The Akiba Mashinani Trust promotes housing, sanitation, and other causes in Mukuru and other slums in Nairobi
• AMT law suit
• AMT petition
The intervention• We screen a selection of motivational videos delivered to women in Mukuru, a Nairobi slum
• Motivational Treatment– Makutano Junction+– Ni Sisi clips
• Placebo arm– “Mother in law,” a
popular Kenyan soap
• Explicit call to action
– Akiba Mashinani Trust
– Information about an on-going signature campaign
The Design
+Explicit call to action regarding sanitation
Explicit call to action regarding sanitation
Trea
tmen
tPl
aceb
o
No call to action
No call to action
Cont
rol
x No call to action
Mukuru slum
Venues
• Schools inappropriate for day-time showing• Video halls frequented by young males –
inappropriate for our sample
Venues
• Videos screened twice a day (morning and afternoon), four days a week
Video sessions
Outcomes of interest
• Willingness to sign the AMT petition
• Other indicators of collective action– Responses to vignettes– Locus of control and optimism– Preferences for public goods– Civic participation and engagement
Sampling and recruitment and women
• 150 circles of radius 50m (exclude vacant land, swamps, etc.)
• Randomly assign circles to T, P, and C
• Up to 50 women recruited within each circle Treatment Placebo Control
1,953 1,852 1,910
Location of venues and treatment clusters
Invitations*
* Courtesy of Well Told Story
Implementation
Baseline data: Treatment-Control balance
Treatment-Placebo balance (I)
Treatment-Placebo balance (II)
• Individuals asked to state degree of agreement with the following statements:
Measuring self-efficacy
Baseline self-efficacy
0
.05
.1
.15
Den
sity
15 20 25 30 35 40total_ses
Control Makutano MiL
kernel = epanechnik ov, bandwidth = 0.5889
Distribution of Self-Eff icacy Scores
Baseline group membership
Awareness of community initiatives
Priority initiatives
Baseline engagement with political figures
Baseline political participation
Baseline action on sanitation
Video attendance
0 1 2 3 4 5 6 7 8 9 10 11 120%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Number of shows, n
Shar
e th
at v
iew
ed a
t lea
st n
show
s
Placebo
Treatment
Attrition at endline survey
• Participation in the petition
• Responses to vignettes
• Measures of self efficacy
• Levels of community engagement
Results
• Intent to treat – by treatment assignment
• 2SLS – using treatment assignment and distance to venue as instruments for attendance
Estimates
First stage (1) (2) (3) (4)
Attended at least one show Makutano MiLMakutano & AMT
MiL & AMT
Makutano Junction 0.483*** 0.005 0.064** 0.005(0.043) (0.005) (0.027) (0.005)
Makutano Junction & AMT -0.005 -0.010 0.375*** -0.010(0.051) (0.009) (0.038) (0.009)
Makutano Junction & AMT & Distance -0.000*** 0.000 -0.000* 0.000(0.000) (0.000) (0.000) (0.000)
Mother-in-Law 0.008 0.372*** 0.004 0.017(0.005) (0.038) (0.003) (0.020)
Mother-in-Law & AMT -0.003 0.082** 0.004 0.427***(0.007) (0.042) (0.004) (0.031)
Mother-in-Law & AMT & Distance 0.000 -0.000 -0.000 -0.000(0.000) (0.000) (0.000) (0.000)
Distance -0.000 -0.000 -0.000 -0.000(0.000) (0.000) (0.000) (0.000)
Observations 5,556 5,556 5,556 5,556Mean, control 0.141 0.132 0.074 0.073R-squared 0.298 0.295 0.328 0.361MakutanoAMT=MiLAMT 64.33 47.75 3.591 0.804Prob > F 0.000 0.000 0.0300 0.449Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1
Petition: did you sign? - ITTPanel A: ITT (1) (2)Makutano Junction -0.026 -0.026
(0.045) (0.038)Mother-in-Law 0.008 0.012
(0.038) (0.033)Makutano Junction & AMT -0.047 -0.056
(0.054) (0.050)Mother-in-Law & AMT -0.090* -0.088**
(0.046) (0.043)R-squared 0.009 0.012Makutano=MiL 0.251 0.427Prob > F, Makutano=MiL 0.779 0.653Observations 4,108 3,926Mean, Control 0.727 0.755Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1Note: Second regression excludes ineligible signatures
Panel B: IV Attended at least one show (1) (2)Makutano Junction -0.073 -0.064
(0.115) (0.099)Mother-in-Law 0.015 0.032
(0.103) (0.091)Makutano Junction & AMT -0.120 -0.141
(0.144) (0.138)Mother-in-Law & AMT -0.211* -0.210*
(0.117) (0.110)Observations 4,108 3,926Mean, Control 0.727 0.755Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1Note: Second regression excludes ineligible signatures
Petition: did you sign? - IV
Vignette 1Mike lives in a house that like others in his area has lots of solid waste disposal outside. In particular, there is a drain outside his house that floods occasionally creating a very unhealthy environment for children in the area. Mike and his neighbors would really like to have the drain cleared so rainwater can flow away from their homes. If you were Mike’s neighbor, would you take any of the following actions?
• Ask someone in your household to help clear up the drain? Yes/No
• Contribute to a fund to pay for the civil works required? Yes/No
• Talk to the village chairman to do something about the drainage? Yes/No
• Start looking for alternative accommodation? Yes/No
Vignette 1: ITT (1) (2) (3) (4) (5) Vin1 Q1 Vin1 Q2 Vin1 Q3 Vin1 Q4 Std. EffectPanel A: ITT results Makutano Junction -0.005 -0.031 0.025 0.091* 0.044
(0.041) (0.053) (0.044) (0.054) (0.032)Mother-in-Law -0.057 -0.143*** -0.064 -0.038 0.006
(0.046) (0.047) (0.051) (0.049) (0.035)Makutano Junction & AMT 0.010 -0.013 0.009 0.006 -0.165***
(0.037) (0.059) (0.047) (0.055) (0.032)Mother-in-Law & AMT -0.014 0.072 0.031 -0.032 0.027
(0.057) (0.045) (0.060) (0.049) (0.037)R-squared 0.007 0.013 0.009 0.020 Makutano=MiL 0.826 5.022 1.281 3.128 37.75Prob > F, Makutano=MiL 0.440 0.008 0.281 0.0468 0.000Observations 4,073 4,073 4,073 4,073 4,103Mean, Control 0.821 0.621 0.786 0.551 Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1
Vignette 2Alice was robbed on her way home from the market by some unknown individuals. She brings her complaint to the local police station in order to have the individuals apprehended and her property returned. The officer in charge tells her that there is very little he can do as he is under-staffed and has no resources to investigate the case or for that matter deploy patrols to deter future crime. Alice is considering a few options to recover her property and reduce crime in her neighborhood. Alice would like your help in improving her community. Would you agree to:
• Bring up this matter with the village headman and other political leaders to seek funding for the local police? Yes/No
• Be part of a local neighborhood watch group to keep out criminals? Yes/No
• Let her stay with you for a few days as she looks for another place to live? Yes/No
• Contribute to a fund to support the local police station provide services? Yes/No
Vignette 2: ITT (1) (2) (3) (4) (5) Vin2 Q1 Vin2 Q2 Vin2 Q3 Vin2 Q4 Std. EffectPanel A: ITT results Makutano Junction -0.017 0.004 0.037 0.007 0.021
(0.056) (0.055) (0.057) (0.059) (0.033)Mother-in-Law -0.132** -0.032 -0.049 -0.068 -0.010
(0.054) (0.053) (0.054) (0.052) (0.037)Makutano Junction & AMT 0.010 0.018 -0.010 -0.033 -0.139***
(0.057) (0.055) (0.061) (0.059) (0.031)Mother-in-Law & AMT 0.020 0.001 -0.044 -0.023 -0.021
(0.058) (0.056) (0.051) (0.053) (0.035)R-squared 0.014 0.007 0.013 0.011 Makutano=MiL 3.148 0.253 1.101 1.131 26.11Prob > F, Makutano=MiL 0.046 0.777 0.335 0.325 0.000Observations 4,073 4,073 4,073 4,073 4,103Mean, Control 0.628 0.677 0.413 0.497
Vignette 3The local water supply in Wangeci’s community is not very clean. Wangeci is concerned about the health of her elderly parents who cannot afford to boil the water or use a water filter. Wangeci does some research and has been told that the community will need to raise 50,000 Kshs to protect the well and improve the quality of the water. Another option is to start a signature campaign to motivate the local government to pay for the well protection. Which of these two options would you advise Wangeci to pursue?.
• Community fundraising to protect the well?
• A signature campaign to engage the local government?
Vignette 3: ITT (1) (2) (3) Vin3 Q1 Vin3 Q2 Std. EffectPanel A: ITT results Makutano Junction 0.008 0.022 0.040
(0.051) (0.037) (0.033)Mother-in-Law -0.041 -0.052 -0.051
(0.045) (0.036) (0.037)Makutano Junction & AMT -0.009 -0.031 -0.104***
(0.053) (0.044) (0.034)Mother-in-Law & AMT 0.004 0.046 0.059
4,073 4,073 (0.040)R-squared 0.004 0.005 Makutano=MiL 0.604 1.862 15.39Prob > F, Makutano=MiL 0.548 0.159 0.000Observations 4,073 4,073 4,103Mean, Control 0.635 0.792 Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1
Vignette 4Mumbi discovers the teachers at her child’s school have been skipping class. She confronts the deputy head teacher who tells her that the reason for the absence is that teachers have very large classes, and their salary has not been paid for three months. Her child has just started grade 3 but still cannot read simple sentences. Mumbi is desperate to make sure her child learns these important skills. She asks for your advice on the following options that she is considering? Do you think the following would be a sensible course of action?
• Moving her child to a private school? Yes/No
• Fundraising for the school to hire a few more contract teachers? Yes/No
• Going to the radio/newspapers to raise the issue of teacher compensation? Yes/No
• Raising the absenteeism problem with the school management committee? Yes/No
Vignette 4: ITT (1) (2) (3) (4) (5) Vin4 Q1 Vin4 Q2 Vin4 Q3 Vin4 Q4 Std. EffectPanel A: ITT results Makutano Junction 0.033 -0.009 -0.032 0.001 0.002
(0.057) (0.058) (0.056) (0.027) (0.031)Mother-in-Law -0.042 -0.101* -0.120** -0.048 0.013
(0.053) (0.059) (0.053) (0.030) (0.034)Makutano Junction & AMT 0.025 -0.007 0.000 0.005 -0.167***
(0.061) (0.062) (0.062) (0.027) (0.030)Mother-in-Law & AMT 0.001 0.084 -0.007 0.047 0.078**
(0.061) (0.065) (0.060) (0.031) (0.034)R-squared 0.007 0.010 0.013 0.006 Makutano=MiL 0.716 1.640 2.674 1.557 34.98Prob > F, Makutano=MiL 0.490 0.198 0.072 0.214 0.000Observations 4,073 4,073 4,073 4,073 4,103Mean, Control 0.567 0.582 0.402 0.889 Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1
Vignette 5
Eva thinks her local community leader does not care about local issues that primarily affect women. In the next election, she decides to run for his position to try and change the situation.
• Do you think that Eva’s approach, to run for office, is a good way to make positive social change?
Vignette 5: ITT (1) Vin5 Q1Panel A: ITT resultsMakutano Junction -0.036
(0.045)Mother-in-Law -0.082*
(0.043)Makutano Junction & AMT 0.031
(0.045)Mother-in-Law & AMT 0.038
(0.046)R-squared 0.009Makutano=MiL 0.594Prob > F, Makutano=MiL 0.553Observations 4,073Mean, Control 0.84Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1
Ex post locus of control
Engagement and decision making: ITT (1) (2) (3) (4) (5)
Community
LeaderGroup
MemberAttend Groups
Engagement Index
Decision-Making
Panel A: ITT results Makutano Junction -0.061 -0.007 -0.001 -0.035 0.022
(0.047) (0.046) (0.007) (0.055) (0.047)Mother-in-Law -0.099*** -0.049 0.006 -0.086* 0.031
(0.038) (0.041) (0.006) (0.044) (0.043)Makutano Junction & AMT 0.021 0.030 -0.008 0.043 0.001
(0.053) (0.043) (0.008) (0.061) (0.054)Mother-in-Law & AMT 0.029 -0.039 -0.009 -0.004 -0.014
(0.053) (0.046) (0.006) (0.058) (0.054)R-squared 0.010 0.013 0.004 0.015 0.005Makutano=MiL 3.627 0.783 1.138 1.866 0.273Prob > F, Makutano=MiL 0.029 0.459 0.323 0.158 0.762Observations 4,073 4,073 4,556 4,073 3,060Mean, Control 0.646 0.459 0.977 0.043 0.654Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1
Engagement and decision making: IV
(1) (2) (3) (4) (5)
Community
LeaderGroup
MemberAttend Groups
Engagement Index
Decision-Making
Makutano Junction -0.135 0.010 -0.003 -0.061 0.051(0.123) (0.112) (0.017) (0.137) (0.117)
Mother-in-Law -0.261** -0.122 0.019 -0.223* 0.082(0.107) (0.117) (0.016) (0.127) (0.120)
Makutano Junction & AMT 0.060 0.074 -0.022 0.109 -0.000(0.139) (0.109) (0.020) (0.156) (0.138)
Mother-in-Law & AMT 0.114 -0.066 -0.024 0.033 -0.047(0.136) (0.119) (0.016) (0.151) -0.136
Observations 4,073 4,073 4,556 4,073 3,060Mean, Control 0.646 0.459 0.977 0.043 0.654Robust standard errors in parentheses*** p<0.01, ** p<0.05, * p<0.1
• There is little discernible effect of the treatment, Makutano Junction
• If anything, exposure to the placebo had negative effects
• Being instructed explicitly to sign a petition seemed to reduce the willingness of women to do so
Conclusion
www.gui2de.org