246194 Design and implementation of a uniform Center-wide evaluation strategy using the Kirkpatrick Model

Monday, October 31, 2011: 9:00 AM

Tanya A. Montoya, MPH , UNC Center for Public Health Preparedness, University of North Carolina at Chapel Hill, Chapel Hill, NC
Lauren N. Bradley, MHS , UNC Center for Public Health Preparedness, University of North Carolina at Chapel Hill, Chapel Hill, NC
Rachel A. Wilfert, MD, MPH, CPH , UNC Center for Public Health Preparedness, University of North Carolina at Chapel Hill, Chapel Hill, NC
Karl Umble, PhD, MPH , North Carolina Institute for Public Health, University of North Carolina Gillings School of Global Public Health, Chapel Hill, NC
Lorraine K. Alexander, DrPH, MPH , UNC Center for Public Health Preparedness, University of North Carolina at Chapel Hill, Chapel Hill, NC
Allison George, MPH, MCHES, CPH , UNC Center for Public Health Preparedness, UNC at Chapel Hill, Chapel Hill, NC
The University of North Carolina Center for Public Health Preparedness (UNC CPHP) Preparedness and Emergency Response Learning Center (PERLC) at the University of North Carolina Gillings School of Global Public Health designed and implemented a novel evaluation strategy to ensure application of a more uniform and consistent approach to evaluating Center-developed/delivered education and training programs. A main thrust of this new strategy is to collect more robust evaluation data for use in measuring both impact on individual learner behavior and organizational results ensuing from participation in Center-sponsored education and training programs. A key component of the strategy focuses on the development of a standardized evaluation question bank, in which questions are organized based upon their relevance to each of the levels of the Kirkpatrick Four LevelTM Evaluation Model. The question bank was populated by conducting a thorough review of a compilation of existing instruments used by the Center for education and training program evaluation and a literature review of relevant evaluation instruments. Each question was categorized according to the level where it best fits within the Kirkpatrick Model, thus grouping questions into 4 general types: reaction-based, learning-based, behavior-based, and results-based. Within each of the 4 categories, questions were further stratified into subcategories, resulting in a user-friendly tool for developing new evaluation instruments. The question bank streamlines UNC CPHP's overall evaluation strategy by encouraging incorporation of standardized questions into individual evaluation instruments, in turn fostering improved and increased ability to demonstrate impact across multiple education and training programs.

Learning Areas:
Conduct evaluation related to programs, research, and other areas of practice
Public health or related education

Learning Objectives:
1. Discuss the development of a standardized evaluation question bank. 2. Describe the Kirkpatrick Four Level Evaluation Model. 3. Demonstrate how a standardized evaluation question bank stratified using the Kirkpatrick evaluation model increases one’s ability to demonstrate impact across training programs and encourages appropriate planning of evaluation measures at all stages of education and training program development.

Keywords: Evaluation, Training

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am qualified to to present because I have been involved in this project since its inception.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.