impact of alchemy, inc. on participants' social emotional learning

Impact of Alchemy, Inc. on Participants’ Social Emotional

Learning 2013-2014

Prepared by: The Research and Evaluation Bureau at Kent State University

2

Table of Contents

Introduction………………………………………. 3-4

Evaluation Focus and Design………........ 5-7

Demographics……………………………………. 8

Descriptive Findings…………………………… 9-52

Open-Ended Questions……………………... 53-58

Highlights………………………………………….. 59-60

Conclusions……………………………………….. 61-62

3

About Alchemy, Inc.

• Alchemy, Inc. is a non-profit organization with a mission to assist urban adolescent males to develop a sense of purpose in life and successfully function as members of a family, school, and community.

• Alchemy’s name is derived from the ancient art of transformation in which medieval alchemists attempted to transform a lower base metal, or prima materia, into gold, called the Philosopher’s Stone. Alchemy works to transform prima materia (urban youth) into the Philosopher’s Stone (the gold inherent within our youth).

• The goals of Alchemy, Inc. include the following: o Increasing Social Emotional Learning (SEL) o Increasing School Attendance o Increasing GPA Averages o Increasing High School Graduation Rates o Increasing College Acceptance Rates o Developing character traits necessary to succeed in life

4

The Sacred Circle of Alchemy, Inc.

• The program uses myth as a sociological and pedagogical tool with the goal of teaching participants how to live in the world together. o The myths also provide examples of how each participant can realize

the personal gifts that he brings to the world.

• Myths are told to the beat of an African drum with the aim of creating a safe environment and sense of community for participants.

• The Sacred Circle of Alchemy, Inc. is derived from the ritual of Aesculapius and other traditional cultures. o Youth are greeted by the adults present and then relate a brief

history of their ailment through the discussion of myth. o Hand sanitizer of some sort is passed around to symbolize washing. o The drumming is reminiscent of the cultures’ sacred song-chanting. o Youth come to the circles to be healed through their analysis and

discussion of myths.

5

Evaluation Focus

• The focus of this evaluation is to address the Social Emotional Learning (SEL) of Alchemy, Inc.

• SEL is defined as the process where students learn to: o Recognize and manage emotions o Care about others o Make good decisions o Behave ethically and responsibly o Develop positive relationships o Avoid negative behavior

• SEL enhances the student’s ability to integrate thinking, feeling, and behaving in order to achieve important life tasks. The major benefits of SEL are to: o Enhance growth and learning o Prepare students for life

6

Evaluation Design

• A survey was administered to 7th and 8th grade participants of the Alchemy, Inc. program. o Participants attend Buchtel CLC, Innes CLC, and Litchfield Middle School.

• A total of 21 surveys were at least partially completed and collected.

• The survey presented participants with major themes that the heroes faced in the myths discussed in the program. There were four to six items for each theme representing challenges in the hero’s quest.

• Participants were asked to consider each item twice and indicate 1) the extent to which they felt they had learned about each item and 2) the extent to which they felt their behavior or attitude has changed in each area as a result of participation in Alchemy, Inc. o Scale:

1=Not at all 2=Only a little, 3=Some, 4=A lot

7

Evaluation Design Continued

• Open-ended questions were also included in the survey to assess:

o Which myths made the biggest impact on participants in terms of each major theme presented

o Who are the most influential males in the lives of participants

o Which myth had the biggest impact overall on participants

o Changes that participants have made in their lives as a result of Alchemy, Inc.

o What participants like most about Alchemy, Inc.

8

Demographics

Buchtel CLC Innes CLC Litchfield Middle School

Grade 7 8 0 0

Grade 8 0 3 9

Unspecified 1 - -

Total 9 3 9

One Year Two Years Three Years Four Years

0 1 9 11

Including this year, how long have you been participating in Alchemy?

Number of students in each grade level at each participating school.

9

Findings

• The survey was divided into sections corresponding to the major themes faced by the heroes in the myths.

• Participants responded according to the extent they had “learned about” each item and then according to the extent to which they had “changed their behavior/attitude” about each item.

• The following slides present descriptive statistics (percentages and averages) for each item within each section.

10

Section 1 Being Connected to Something

Larger than Oneself

11

Recognizing the rights of others

n=21; mean=3.43

Scale: 1=Not at all, 2=Only a little, 3=Some, 4=A lot

47.6 47.6

4.8 0.0

0

20

40

60

80

100

A lot Some Only a little

Not at all

Pe

rce

nt

Learned

42.9

52.4

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Behavior or Attitude Changed

n=21; mean=3.38

12

Respecting the points of view of others

n=21; mean=3.62


61.9

38.1

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

52.4 47.6

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.52

13

Accepting and respecting individual differences

n=21; mean=3.52


52.4 47.6

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

33.3

4.8 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.43

14

Accepting and respecting ethnic and cultural differences

n=21; mean=3.29


42.9 42.9

14.3

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

23.8 19.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.38

15

Which myth made the biggest impact on you in terms of learning about becoming connected?

• Love Caused It All (4)

• The Firebird (2)

• The Killing Virtue (2)

• The Water of Life (2)

• Go I Know Not Whither, Bring Back I Know Not What (1)

• Theseus (1)

• Kamo of the East and Kamo of the West (1)

• The Young Giant (1)

• The Hunter and the Boa Constrictor (1)

• The King of the Golden Mountain (1)

• The White Snake (1)

• The Hunter and His Son (1)

Number in parentheses indicates number of responses for each item.

16

Section 2 Acquiring Basic Skills

17

Learning how to set goals

n=21; mean=3.57


57.1

42.9

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

66.7

33.3

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.67

18

Identifying skills I need

n=21; mean=3.43


42.9

57.1

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

38.1

61.9

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.38

19

Finding new ways to solve problems

n=20; mean=3.65


70.0

25.0

5.0 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

19.0 19.0

4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.29

20

Developing coping skills to deal with problems

n=21; mean=3.29


47.6

33.3

19.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

28.6

52.4

14.3

4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.05

21

Not giving up in learning new skills

n=20; mean=3.50


55.0

40.0

5.0 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

66.7

33.3

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.67

22

Searching for helpful resources

n=20; mean=3.30


40.0

50.0

10.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

42.9

52.4

0.0 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.33

23

Which myth made the biggest impact on you in terms of learning about acquiring basic skills?


• Podare (3)


• The Two Brothers (1)




• Old Woman in the Woods (1)


24

Section 3 Forming Relationships with Peers,

Family, and the Community

25

Learning how to make and keep friends

n=21; mean=3.48


52.4

42.9

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

33.3

4.8 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.43

26

Recognizing the feelings of others

n=21; mean=3.38


47.6 42.9

9.5

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

42.9

52.4

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.38

27

Using effective communication skills

n=21; mean=3.38


42.9

52.4

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

47.6 42.9

9.5

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.38

28

Listening to others

n=21; mean=3.57


66.7

23.8

9.5

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

38.1

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.52

29

Being considerate of others

n=21; mean=3.48


52.4

42.9

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

42.9

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.57

30

Which myth made the biggest impact on you in terms of learning about forming relationships?







• Old Woman in the Woods (1)


• The Golden Goose* (1)

*Participant read myth on own


31

Section 4 Charting a Safe Course

32

Making safe and healthy choices

n=21; mean=3.67


66.7

33.3

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

42.9

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.57

33

Setting my own boundaries

n=20; mean=3.45


55.0

35.0

10.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

40.0

55.0

5.0 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=20; mean=3.35

34

Coming up with ways to achieve goals

n=21; mean=3.33


38.1

57.1

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

47.6

33.3

19.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.29

35

Knowing what my strengths are

n=19; mean=3.37


47.4 42.1

10.5

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

57.1

28.6

14.3

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.43

36

Knowing what my values and beliefs are

n=20; mean=3.45


50.0 45.0

5.0 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

47.6

38.1

14.3

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.33

37

Dealing with peer pressure

n=21; mean=3.24


42.9 42.9

9.5 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

33.3

52.4

9.5 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.14

38

Which myth made the biggest impact on you in terms of learning about charting a safe course?





• Conn-eda (2)


• Theseus (1)

• Podare (1)

• The Boy Who Did Not Fear* (1)



39

Section 5 Living in Multiple Worlds

40

Identifying my feelings

n=21; mean=3.24


42.9 38.1

19.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

52.4

33.3

14.3

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.38

41

Expressing my feelings appropriately

n=20; mean=2.95


25.0

50.0

20.0

5.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

30.0

65.0

5.0 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=20; mean=3.25

42

Dealing with stress and conflict

n=20; mean=3.20


45.0

30.0 25.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

55.0

25.0

15.0

5.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=20; mean=3.30

43

Being cooperative in groups

n=20; mean=3.50


55.0

40.0

5.0 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

65.0

35.0

0.0 0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=20; mean=3.65

44

Adjusting to different situations

n=20; mean=3.35


50.0

40.0

5.0 5.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

50.0

40.0

5.0 5.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=20; mean=3.35

45

Which myth made the biggest impact on you in terms of learning about living in multiple worlds?

• Love Cause It All (10)


• Fedot's Wife (2)



• The King and his Corpse (1)

• The Crystal Ball (1)


46

Section 6 Taking Responsibility for Oneself

47

Knowing the difference between appropriate and inappropriate behavior

n=21; mean=3.62


76.2

14.3

4.8 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

61.9

28.6

4.8 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.48

48

Understanding that self-control is important

n=21; mean=3.33


38.1

57.1

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

66.7

28.6

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.62

49

Understanding the consequences of my decisions

n=21; mean=3.57


66.7

23.8

9.5

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

61.9

33.3

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.57

50

Knowing how to seek help when needed

n=21; mean=3.19


42.9 38.1

14.3

4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

61.9

33.3

4.8 0.0

0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.57

51

Recognizing how my choices impact others

n=21; mean=3.43


57.1

33.3

4.8 4.8

0

20

40

60

80

100


Not at all

Pe

rce

nt

Learned

38.1 42.9

19.0

0.0 0

20

40

60

80

100


Not at all

Pe

rce

nt


n=21; mean=3.19

52

Which myth made the biggest impact on you in terms of learning about taking responsibility?


• Podare (2)

• The Hunter and the Boa Constrictor (1)


• Go I Know Not Whither, Bring Back I know Not What (1)



• Golden Bird (1)

• The Nail* (1)



53

Responses to Open-Ended Questions

54

Please list the most influential males in your life.

Note: Participants were permitted to list more than one.

Most Influential Male Number of Responses

Alchemy instructors 8

Father 8

Grandfather 5

Uncle 5

Step-Father 3

Older Brother 3

Older Alchemy Participant 3

Pastor 1

Public Figure 1

55

Which myth had the biggest impact on you overall? Why?

• Love Caused It All (4) o “It made me think a lot”

• The Firebird (3) o “Because the kid did what he had to do with almost no questions

asked” o “It shows that for every action and every decision you make,

there is either a good or bad consequence”

• The Killing Virtue (3) o Learned about not giving up

• The Young Giant (2) o “Because it showed a lot of transformation”

• The Water of Life (2) o “It made me open my eyes to new understandings”


(Continued on next slide)

56

Which myth had the biggest impact on you overall? Why?


• Golden Bird (1) o Learned to be persistent even after messing up

• Skillful Huntsman (1) o “It taught me responsibility”


• The Father and His Sons (1) o “It taught me to bond with my brother more”

• Old Woman in the Woods (1) o “It made me think if I were in that situation what would I do

without people I need”


57

List two to three changes you have made in your life due to participating in Alchemy.

• Interpersonal Skills o Listens to others more (4) o Greater respect for others (3) o Decreased conflict with

others (2) o Improved communication

skills (1) o Spends more time with

friends (1)

• Academics o Greater focus on academics/

has improved grades (13) o Focuses on tasks (1)

• Social Emotional Learning o Improved behavior (5) o Improved attitude (4) o Thinks before acting (2) o More responsible (1) o More mature (1) o Less responsive to peer

pressure (1)

• Other o Planning for the future (1) o Greater creativity (1)


58

What do you like most about Alchemy?

Responses:

• The myths

• The drumming

• The workshops

• Being in the circle

• The field trips

• Learning about transformation

• Learning how to be a good citizen

• Learning the difference between right and wrong

• How everyone cares about each other

• How everyone is open-minded and doesn’t judge

• Being able to communicate freely

• The friendships

• It’s fun

• Everything

“What I like most is the whole program because it

turned my life around.”

59

Highlights: Perceptions of Learning

• Of the 31 items pertaining to participant perceptions of what they had learned:

o 74% received ratings of a lot or some by at least 90% of the participants

o 19% received ratings of a lot or some by 80-89% of the participants


60

Highlights: Perceptions of Behavior/Attitude Change

• Of the 31 items pertaining to participant perceptions of changes they made pertaining to their behavior/attitude:

o 68% received ratings of a lot or some by at least 90% of the participants



61

Conclusions

• Participants in Alchemy, Inc. generally indicated positive social emotional development in all of the items surveyed.

• Students stated that the program has helped them listen more, do better academically, and demonstrate improved behavior.

• Alchemy instructors were cited equal with fathers as being the most influential males in their lives.

• In terms of social emotional learning, Alchemy, Inc. appears to be a very effective program.

62

Recommendations

• Based on survey findings, three areas for further development in the future include the following: o Implementing behavior change in regards to finding new ways to

solve problems o Identifying and expressing feelings o Dealing with stress and conflict, including peer pressure

Report Prepared by Stacie Berg

Directed by Deborah Shama-Davis, Ph.D.

Research and Evaluation Bureau

Kent State University

July 2014

impact of alchemy, inc. on participants' social emotional learning

Documents