243358 Metrics for Evaluating Community Health Workers: Challenges and Opportunities

Monday, October 31, 2011

Ephraim Shapiro, PHD, MPA, MBA , School of Medicine, New York University, New York, NY
Chau Trinh-Shevrin, DrPH , Center for the Study of Asian American Health, NYU Institute of Community Health and Research, New York, NY
Simona Kwon, DrPH, MPH , Center for the Study of Asian American Health, New York University School of Medicine, New York, NY
Nadia Islam, PhD , Center for the Study of Asian American Health, NYU Institute of Community Health and Research, NYU School of Medicine, New York, NY
Rhodora Ursua, MPH , Center for the Study of Asian American Health, NYU School of Medicine, New York, NY
Mariano Rey, MD , Center for the Study of Asian American Health, NYU Institute of Community Health and Research, New York University School of Medicine, New York, NY
Introduction: Community Health Workers seem to have great potential to reduce disparities and their use has been rapidly increasing. However, current research is not fully conclusive on CHWs' effectiveness. Few studies have integrated evaluations with common metrics, especially looking beyond narrow clinical measures and/or subpopulations. Objectives: This study sought to determine 1) What is the current state of knowledge about metrics used in evaluating community health workers 2) What new metrics would be beneficial in evaluating CHWs and 3) What are the challenges in developing these new metrics. Methods: A review of the literature and current practices was performed. Intensive interviews were conducted with CHWs for three programs developed to target diabetes or hypertension for Asian-Americans in NYC. These programs used a CBPR approach in collaboration between NYU School of Medicine and community partners in NYC. Measures were made consistent across interventions and metrics developed to evaluate outcomes; metrics were related to the Community Health Worker theoretical change mechanism model developed. Measures involving long-term impact such as finding or using a medical home as well as short-term utilization and clinical measures were developed or enhanced. Results/Conclusion: Current metrics are not fully adequate to capture all aspects of the critical roles of Community Health Workers and need to demonstrate their impact in the long-term as well as short-term across multiple interventions and populations. Standardizing and/or creating new metrics and developing a framework incorporating what is unique to CHWs would of great value in improving the health of vulnerable populations.

Learning Areas:
Chronic disease management and prevention
Conduct evaluation related to programs, research, and other areas of practice
Diversity and culture
Implementation of health education strategies, interventions and programs
Public health or related research
Systems thinking models (conceptual and theoretical models), applications related to public health

Learning Objectives:
1) Assess what is the current state of knowledge about metrics used in evaluating community health workers 2) Describe new metrics that would be beneficial in evaluating CHWs 3) Understand what are the challenges in standardizing or developing new metrics

Keywords: Community Health, Evaluation

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I have extensive training and experience in program evaluation, community health and chronic diseases
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.