265152 Evaluating fidelity: The role of program and organizational structure in replication outcomes

Monday, October 29, 2012 : 11:15 AM - 11:30 AM

Tammi Fleming, PhD, CHES , Management Services, Public Health Management Corporation, Philadelphia, PA
Jennifer Perkins, PhD, MPH, CHES , School of Health Sciences, Walden University, Minneapolis, MN
Current economic realities suggest a continued decrease in funding available for public health prevention and services. Diminishing public resources require strategic investments of the limited funds and resources available. Recent investments into evidence-based programs suggest an assurance on the return on these investments. While the logic behind this investment strategy is clear, past research indicates that the results of bringing these models to scale, have been less than stellar. Plain Talk is a teen pregnancy and STI prevention program. The initial evaluation of Plain Talk indicated positive trends towards improving adolescent reproductive health outcomes. These positive findings lead to investments in the Plain Talk National Replication Center, with the charge of bringing the model to scale. Although all approved replication sites were provided training on the program and core components of the model, there were broad variations on the indicators of success during program replication. This session will highlight the assumptions behind the recent study and implications for social change. A sequential-explanatory mixed-method design was used to explore the frequency of adaptation of Plain Talk structural elements and the impact that the most frequently altered elements had on replication outcomes. In phase 1, a quantitative assessment on 28 Plain Talk replication sites was conducted to determine adaptation frequency of six structural elements. Contingency tables and Fisher's exact test were used to analyze relationship between these variables and replication outcomes. In the second phase, two case studies with semi structured interviews were developed on one successful and one unsuccessful replication site.

Learning Areas:
Conduct evaluation related to programs, research, and other areas of practice
Implementation of health education strategies, interventions and programs
Program planning

Learning Objectives:
1. Articulate the need to broaden the lens of fidelity research on evidence-based programs 2. Describe why a sequential-explanatory mixed-methods design was used in the initial attempt to determine the impact of structural fidelity on replication outcomes 3. Discuss the outcomes of a recent study to determine the impact of structural fidelity on replication of the Plain Talk program model 4. List key recommendations for future studies on replication outcomes

Keywords: Evidence Based Practice, Evaluation

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I was the principal investigator in this study. In addition to my scientific interest, I have worked as a replication specialist and program implementer.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.