197458 Using evaluation results to improve program delivery, design and policy

Tuesday, November 10, 2009: 8:30 AM

Traci Hart, PhD, MA , Department of Preventive Medicine and Public Health, University of Kansas School of Medicine-Wichita, Wichita, KS
Ruth Wetta-Hall, RN, PhD, MPH, MSN , Preventive Medicine and Public Health, University of Kansas School of Medicine-Wichita, Wichita, KS
Amy Chesser, PhD, MA , Department of Family and Community Medicine, University of Kansas School of Medicine-Wichita, Wichita, KS
Sandra E. Pickert, RN, MPH, BSN , Pure & Simple Lifestyle Project, Pure & Simple Health Education, Inc., Wichita, KS
The Pure & Simple Lifestyle program teaches adolescents, their parents, and other interested community members the value of an abstinence-until-marriage approach to sexual activity and abstinence from other harmful behaviors, including: use of illegal drugs, alcohol, tobacco, pornography, and violence. The project approach is one of a primary prevention health perspective. The target population includes urban and rural youth, ages 12 to 18. The project uses a peer mentoring approach by high school-aged volunteer “Teen Instructors” and college-aged “Coaches” to model desired characteristics of practicing abstinence from potentially harmful behaviors.

The purposes of community-based health promotion (CBHP) program evaluation are to: (1) document effectiveness and impact interventions; (2) determine if goals and objectives are met; (3) demonstrate the program's cost-effectiveness to stakeholders; and (4) assist with development and maintenance of program sustainability.

Continuous Quality Improvement (CQI) is an evidence-based process used to assess outcomes and monitor indicators to show improvement. Using a “Plan-Do-Check-Act” (PDCA) model, program activities are assessed to improve curriculum content, delivery, measurement, program management, and community engagement. If the process is successful, it becomes standard operating procedure, otherwise, the sources of failure are analyzed, new solutions designed, and the PDCA cycle is repeated.

The PDCA-CQI process has taken this Project from an idea initially created for a grant proposal to an effectively implemented abstinence education program with demonstrable positive community-wide impact on area teens and adults. This presentation will demonstrate the value of evaluation to improve program design and delivery.

Learning Objectives:
List the different types of program evaluation described in the literature (formative, process, impact, and outcome evaluation). Describe the steps to evaluation using a “Plan-Do-Check-Act” model. Describe the practical uses of evaluation results.

Keywords: Evaluation, Quality Improvement

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: Traci Hart, Teaching Associate in the Department of Preventive Medicine and Public Health at the University of Kansas School of Medicine - Wichita, holds a master degree in experimental psychology and is pursuing a doctorate in human factors psychology. As an investigator of the Research and Evaluation Associates in Community and Clinical Health (REACH) Center, Traci has supported the design and implementation of studies that serve clinical and community-based organizations. Traci serves as the lead on one of the three program evaluation projects for Community-Based Abstinence Education (CBAE) federally-funded programs sub-contracted to the REACH Center.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.

See more of: Promoting Healthy Children through School, Parent, and Community Involvement
See more of: Community Health Planning and Policy Development