Online Program

Community-based evaluation of a coach-led violence prevention program: Implementing a program evaluation toolkit

Monday, November 4, 2013 : 8:30 a.m. - 8:50 a.m.

Maria Catrina Virata, MPH, Division of Adolescent Medicine, Children's Hospital of Pittsburgh, University of Pittsburgh Medical Center, Pittsburgh, PA
Heather L. McCauley, ScD, ScM, Division of Adolescent Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA
Sarah Pritchard, Futures Without Violence, San Francisco, CA
Brian O'Connor, Futures Without Violence, San Francisco, CA
Hillarye Hightower, Denton County Friends of the Family, Corinth, TX
Hilda Gutiérrez, Texas Council on Family Violence, Austin, TX
Elizabeth Miller, MD, PhD, Division of Adolescent and Young Adult Medicine, Children's Hospital of Pittsburgh, University of Pittsburgh Medical Center, Pittsburgh, PA
Engaging men and boys in preventing violence against women and girls is recognized by global health organizations as a potential public health strategy. The “Coaching Boys Into Men” (CBIM) program is a evidence based program intended to alter gender norms that foster teen dating violence (TDV) and sexual violence (SV), promote positive bystander intervention and, ultimately, reduce TDV/SV perpetration.

There are multiple challenges with dissemination and implementation of evidence-based programs in communities, including evaluation of those programs in local settings. To address some of these challenges, strategies to facilitate community-based evaluation are needed to assist community partners and stakeholders to self-administer an evaluation plan and to report on the effectiveness of the program locally.

Academic partners designed an evaluation toolkit for CBIM that would provide community partners the opportunity to evaluate program effectiveness using previously tested measures, but without the expense of an external evaluator. The toolkit consist of codebooks, surveys and excel analysis tools to summarize frequencies, percentages and mean scores for athletes and coaches behavior related to knowledge and promotion of violence prevention. The evaluation toolkit was implemented in high schools in Texas through a collaboration among domestic violence prevention advocates, school staff and administration, and the research team. Piloting the toolkit in this partnership provided an opportunity to identify and adjust usability and to check the feasibility of implementing this evaluation in the context of local program implementation. Development of such easy-to-use evaluation tools to accompany evidence-based programs have the potential to enhance local implementation of programs.

Learning Areas:

Conduct evaluation related to programs, research, and other areas of practice

Learning Objectives:
Discuss the development and piloting of this “Coaching Boys Into Men” program evaluation toolkit. Explore how collaboration worked with local and national domestic violence organizations, school staff and administration, and research team to implement program evaluation tools. Describe challenges with implementation of the program evaluation tools and next steps for continued quality improvement.

Keyword(s): Violence Prevention, Evaluation

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I have been a part of the CBIM evaluation team from the project's inception and have collaborated with the project's national partner - Futures Without Violence - for six years. More broadly, I am a social epidemiologist whose work focuses on gender-based violence. I have more than two dozen publications related to the topic of this presentation.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.