Online Program

Seeing the big picture through the lens of a small budget: Using a multi-method evaluation approach for a Comprehensive Cancer Control (CCC) Program

Tuesday, November 3, 2015

Nikie Sarris Esquivel, MPH, Community Health Promotion Research, RTI International, Research Triangle Park, NC
Cindy Soloe, MPH, Community Health Promotion Research, RTI International, Research Triangle Park, NC
Mahima Ashok, Ph.D., M.S., Social and Health Organizational Research and Evaluation, RTI International, Waltham, MA
Sharon Mallory, MPH, Vermont Department of Health, Burlington, VT
Leanne Shulman, MS, Vermont Department of Health, Burlington, VT
Background: In 1998, the Centers for Disease Control and Prevention (CDC) established the National Comprehensive Cancer Control Program (NCCCP), which provided funding for states to develop and implement cancer plans. As a funding requirement, all CCC Programs must demonstrate outcomes through evaluation.  This presentation outlines a multi-method approach to CCC Program evaluation, using the evaluation of Vermont’s CCC Program as an example. 

Description: Following CDC’s guidance, the Vermont Department of Health (VDH) and RTI focused on evaluating the “three P’s”: Partnership, Plan and Program. The team used CDC’s CCC Branch Program Evaluation Toolkit to develop the evaluation plan.  A key planning tool was the Evaluation Planning Matrix (EPM), which highlighted unique methods for each evaluation area.  RTI used a combination of online surveys and interviews with CCC coalition members and partners, along with document review, to gain a comprehensive understanding of strengths and areas for improvement, while working within a limited budget. 

Lessons Learned: It is possible to manage resources without compromising evaluation integrity.  Online surveys were a low-moderate resource intensive approach to access a wide breadth of respondents with minimal burden, allowing for rich data collection about topics such as coalition member satisfaction and partners’ use of the state cancer plan.  Document review provided a low-moderate resource intensive approach to objectively assess gaps in the state cancer plan and areas for improvement.  Interviews were a moderate-high resource intensive approach to gather detailed data from prioritized participants who had unique insights regarding the implementation of the state cancer plan. 

Recommendations: Using a resource conscious, multi-method evaluation approach informed by key stakeholders at varied degrees of engagement can result in a comprehensive evaluation with applicable findings.  Creating an EPM can help identify priorities and gaps, direct CCC Program-level efforts, and create a clear roadmap for prioritizing evaluation methods.

Learning Areas:

Conduct evaluation related to programs, research, and other areas of practice
Public health administration or related administration

Learning Objectives:
Describe a multi-method CCC Program evaluation approach. List effective evaluation strategies for CCC Programs with limited resources.

Keyword(s): Evaluation, Cancer

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am the Project Director and have been intimately involved in all of the evaluation activities described in this abstract.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.