3029.0: Monday, November 13, 2000 - Board 3

Abstract #12683

IHS Injury Prevention Program Evaluation Methods Development and Pilot Test

Carolyn E. Crump, PhD, Department of Health Behavior & Health Education, University of North Carolina-Chapel Hill, CB#7505, 248 Chase Hall, Chapel Hill, NC 27599-7505, 919-966-5598, ccrump@sph.unc.edu and Robert J. Letourneau, MPH, UNC Injury Prevention Research Center, University of North Carolina-Chapel Hill, CB#7505, Chase Hall, Chapel Hill, NC 27599-7505, 919-966-3920, Robert_Letourneau@unc.edu.

Purpose: To describe the methods and process used to evaluate the IHS Injury Prevention Program and to pretest the methods in two IHS Areas. Methods Development: Evaluation methods were developed based on the 1994 IHS IPP Guidelines and public health principles of practice. Data collection protocols guided interviews, site visit observations, and document collection. The evaluators developed the Program Stage of Development Assessment Tool to provide a consistent way to assess, interpret, and summarize each Area's stage of development for 12 Evaluation Components (e.g., mission/vision, management support). Extensive information was analyzed for each Evaluation Component and respective indicators from documents, interviews, site visits, focus groups, and surveys. A report summarized ratings, contextual factors and recommendations. Results: Pretest of the methods resulted in some revisions to data collection protocols and assessment tool. Program strengths and challenges were identified and summarized in Area Program Evaluation Reports. Recommendations to overcome barriers, based on contextual factors and the experience and expertise of the evaluators, were provided in the report to Area IP staff for each of the 12 Evaluation Components. Conclusions: Program evaluation is dependent upon the amount and quality of information, particularly documentation, provided prior to, during and following site visits. The Program Stage of Development Assessment process used was well received by IHS Area, District, and Service Unit IPP staff. The quality and quantity of information collected by evaluators was sufficient to assess the two pilot-test Area's Program Stage of Development and to provide specific recommendations to enhance the Area's IPP.

Learning Objectives: By the end of this presentation, participants will be able to: 1. Describe the pilot-test data collection and analysis methods developed to evaluate the IHS Injury Prevention Program. 2. Discuss the process used to evaluate the IHS Injury Prevention Program. 3. Describe the lessons learned in pilot-testing program evaluation methods at the Oklahoma City and Navajo Area Injury Prevention Programs

Keywords: Injury Prevention, Evaluation

Presenting author's disclosure statement:
Organization/institution whose products or services will be discussed: None
I do not have any significant financial interest/arrangement or affiliation with any organization/institution whose products or services are being discussed in this session.

The 128th Annual Meeting of APHA