Online Program

Real World of Replication: A South Carolina Case Study

Tuesday, November 3, 2015 : 11:00 a.m. - 11:15 a.m.

Mary Prince, MPH, PhD, South Carolina Campaign to Prevent Teen Pregnancy, Columbia, SC
Sarah Kershner, MPH, CHES, Department of Research and Evaluation, South Carolina Campaign to Prevent Teen Pregnancy, Columbia, SC
Karin Coyle, PhD, Research Department, ETR Associates, Scotts Valley, CA
Forrest Alton, MSPH, CHES, South Carolina Campaign to Prevent Teen Pregnancy, Columbia, SC
Susan Potter, MS, Research Department, ETR Associates, Scotts Valley, CA
Jill R. Glassman, PhD, MSW, Research Department, ETR Associates, Scotts Valley, CA
Background:  In 2010, the Office of Adolescent Health awarded $75million to 75 grantees across the country to support the replication of evidence-based teen pregnancy prevention programs (EB-TPP) which demonstrated, through rigorous evaluation, to be effective in preventing teen pregnancy and/or associated risks.  The intention of these awards was to help bring evidence-based initiatives to more communities across the country. 

Objective:  To discuss whether EB-TPPs with demonstrated effectiveness for a specific population can replicate with efficacy without adaptations to the local context.

Methods:  A randomized cohort of 1725 intervention and 1418 comparison students representing 24 middle schools across rural SC were surveyed pre, post and 12-month post exposure to a two year (12 lessons per year) school-based EB-TPP.  

Results: At the conclusion of the study, the implementation analyses demonstrated a high degree of fidelity to the original curriculum, high dosage, and equal attrition across the two study groups.  Preliminary impact analyses showed that the replication trial found different and conflicting results in onset of sexual initiation, number of sexual partners and contraceptive use at last sex, from the original evaluation conducted by the curriculum developers.

Conclusion:  Four key areas (facilitation, geographic region, implementation schedule and outcomes) that differentiated the original efficacy studies from this effectiveness trial will be discussed and how these differences could have influenced the impact of the replication study will be reviewed.  Presenters will discuss the challenge of how to interpret and use these findings to better understand the tension between replication with fidelity and program effectiveness.

Learning Areas:

Advocacy for health and health education
Conduct evaluation related to programs, research, and other areas of practice
Implementation of health education strategies, interventions and programs
Planning of health education strategies, interventions, and programs
Public health or related research
Social and behavioral sciences

Learning Objectives:
Identify at least three strategies used to select an evidence-based, teen pregnancy prevention program to replicate with fidelity. List at least four challenges to “replicating with fidelity” when taking into account both a randomized control trial study design and program implementation. Describe how to use and interpret evaluation data to plan future teen pregnancy prevention interventions.

Keyword(s): Teen Pregnancy, School-Based Health

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I have been the principal or co-principal of multiple federally funded grants focusing on the implementation and evaluation of teen pregnancy prevention programs. I have a wealth of experience in program evaluation and distance-based learning for public health organizations and community based organizations (CBOs). My primary area of research and publication is on capacity building of CBOs' staff to use science-based approaches in their prevention work.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.