219477 Designing an effective monitoring and evaluation system for a rehabilitation training program in China

Monday, November 8, 2010 : 8:30 AM - 8:50 AM

Shannon H. Houser, PhD , Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL
Wenhui Xiao, MD , Project HOPE Beijing Reprsentative Office, Beijing, China
Qian Geng, MEd , Regional Director, China, Project HOPE, Millwood, VA
     
BACKGROUND/PURPOSE: An 8.0-magnitude devastating earthquake struck China's Sichuan Province in May, 2008, causing 68,000 deaths, 374,176 injuries and many need long-term rehabilitation services. To respond, Project HOPE partnered with the Chinese Ministry of Health (MOH) to pilot a three-year rehabilitation training program in Sichuan Province. It aims to build capacity in rehabilitation services in China through health professional training and systems strengthening.

This presentation illustrates the current program monitoring and evaluation (M&E) system; discuss challenges and lessons learned; and identify a more effective M&E system that best fit the rehabilitation program in China.

METHODS/DATA: An M&E system was developed with indicators and measures for each objective. Data were collected through needs assessments, stakeholder meetings/interviews, pre/post training tests, service and observation from January-December 2009.

RESULTS: 32 rehabilitation service providers from 11 local hospitals received training and coaching from master trainers. Knowledge test scores increased from 20% pre-training to 80-90% post-training. During follow-up on-site coaching sessions, master trainers observed improvement in trainees' clinical performance. The program design, training curriculum, M&E tools were adjusted based on feedback gathered from participants and key stakeholders. The M&E system was well received and recognized by MOH and program staff demonstrated increased M&E skills.

RECOMMENDATIONS: A well-designed M&E system is the key to program success. Practical, easy-to-use M&E tools are equally important in gathering timely information, tracking progress, and assessing outcomes. Participatory M&E process helps improve quality and facilitate program staff learning. The program plans to share the M&E system and experiences with broader audiences in China.

Learning Areas:
Implementation of health education strategies, interventions and programs
Planning of health education strategies, interventions, and programs
Program planning

Learning Objectives:
At the conclusion of the session, the audience will be able to: Illustrate monitoring and evaluation system applied to the rehabilitation program; Explain challenges and lessons learned in evaluation process; Describe an effective monitoring and evaluation system that best fits the rehabilitation program.

Keywords: Evaluation, International

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am an associate professor of the University of Alabama at Birmingham and a member of APHA. I have been working with the project staff on this program evaluation since December 2009.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.

Back to: 3044.0: Monitoring, Evaluation, and Quality Improvement