Online Program

331416
Implementation of an Outcomes-based Evaluation Model for Global Projects


Tuesday, November 3, 2015

Blanca Benaglio, BS, Global Grants & Programs, Susan G.Komen, Dallas, TX
Tauane Cruz, MBA, Global Strategy & Programs, Susan G. Komen, Dallas, TX
Rebecca Earlie-Royer, MPH, CHES, Evaluation and Outcomes, Susan G. Komen, Dallas, TX
Anna Cabanes, PhD, MPH, Global Grants & Programs, Susan G.Komen, Dallas, TX
To determine effectiveness and measure progress in achieving project goals and objectives in its Latin America Program, Susan G. Komen implemented an outcomes-based evaluation (OBE) model to measure knowledge, changes in attitudes, and learned skills acquired through regional initiatives at the community level. The 2015 grant year marks the second year of the shift to OBE, evolving from a limited focus on outputs to comprehensive programmatic assessment. In this process, Komen overcame challenges in time, allocation of resources and a lack of understanding of evaluation at the community level.

Prior to OBE, internal evaluation of project data from projects in Latin America indicated that grantees did not always report outputs related to the funded project, but also reported on non-funded interventions. This limited our ability to identify successful interventions that contribute to our goal to reduce late staged diagnosis and mortality and made it difficult to communicate the results of the programs. As a result, several strategies were integrated throughout the grant-making lifecycle including: grantee orientation meetings, project planning and monitoring tools, and evaluation guidance.

Key to this approach is the Global Impact Chart (GIC), a tracking form designed to capture outputs and outcomes per grantee intervention. By matching project activities with relative GIC measurements, focused data collection limits the amount of data reported outside the project scope.

To date, benefits derived from this new model include: improved accuracy in reporting outcomes and outputs across projects in multiple countries; greater capacity and translation of learned evaluation skills by grantees; and increased ability for Komen to measure the impact of the programs and make data-driven cost-effective funding decisions. All of which contribute to long-term sustainability.

Based on the initial success of the OBE model in the global setting, Komen is replicating a similar framework within its national and international grant-making platform.

Learning Areas:

Administer health education strategies, interventions and programs
Conduct evaluation related to programs, research, and other areas of practice
Diversity and culture
Public health administration or related administration

Learning Objectives:
Identify three strategies that can be used in developing an outcomes-based evaluation model. Name three benefits of implementing an outcomes-based evaluation model. Explain three challenges of implementing an outcomes-based evaluation model within a global setting.

Keyword(s): Evaluation, Public Health Administration

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am the Grants Administrator responsible for implementing the global outcomes-based evaluation model for Susan G. Komen.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.