Seeing the big picture through the lens of a small budget: Using a multi-method evaluation approach for a Comprehensive Cancer Control (CCC) Program

Background: In 1998, the Centers for Disease Control and Prevention (CDC) established the National Comprehensive Cancer Control Program (NCCCP), which provided funding for states to develop and implement cancer plans. As a funding requirement, all CCC Programs must demonstrate outcomes through evaluation.  This presentation outlines a multi-method approach to CCC Program evaluation, using the evaluation of Vermont’s CCC Program as an example. 

Description: Following CDC’s guidance, the Vermont Department of Health (VDH) and RTI focused on evaluating the “three P’s”: Partnership, Plan and Program. The team used CDC’s CCC Branch Program Evaluation Toolkit to develop the evaluation plan.  A key planning tool was the Evaluation Planning Matrix (EPM), which highlighted unique methods for each evaluation area.  RTI used a combination of online surveys and interviews with CCC coalition members and partners, along with document review, to gain a comprehensive understanding of strengths and areas for improvement, while working within a limited budget. 

Lessons Learned: It is possible to manage resources without compromising evaluation integrity.  Online surveys were a low-moderate resource intensive approach to access a wide breadth of respondents with minimal burden, allowing for rich data collection about topics such as coalition member satisfaction and partners’ use of the state cancer plan.  Document review provided a low-moderate resource intensive approach to objectively assess gaps in the state cancer plan and areas for improvement.  Interviews were a moderate-high resource intensive approach to gather detailed data from prioritized participants who had unique insights regarding the implementation of the state cancer plan. 

Recommendations: Using a resource conscious, multi-method evaluation approach informed by key stakeholders at varied degrees of engagement can result in a comprehensive evaluation with applicable findings.  Creating an EPM can help identify priorities and gaps, direct CCC Program-level efforts, and create a clear roadmap for prioritizing evaluation methods.

Learning Areas:

Conduct evaluation related to programs, research, and other areas of practice
Public health administration or related administration

Learning Objectives:
Describe a multi-method CCC Program evaluation approach. List effective evaluation strategies for CCC Programs with limited resources.

Keyword(s): Evaluation, Cancer

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am the Project Director and have been intimately involved in all of the evaluation activities described in this abstract.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.

Back to: 4229.0: Benefits of evaluation and policy development