Implementation of an Outcomes-based Evaluation Model for Global Projects

To determine effectiveness and measure progress in achieving project goals and objectives in its Latin America Program, Susan G. Komen implemented an outcomes-based evaluation (OBE) model to measure knowledge, changes in attitudes, and learned skills acquired through regional initiatives at the community level. The 2015 grant year marks the second year of the shift to OBE, evolving from a limited focus on outputs to comprehensive programmatic assessment. In this process, Komen overcame challenges in time, allocation of resources and a lack of understanding of evaluation at the community level.

Prior to OBE, internal evaluation of project data from projects in Latin America indicated that grantees did not always report outputs related to the funded project, but also reported on non-funded interventions. This limited our ability to identify successful interventions that contribute to our goal to reduce late staged diagnosis and mortality and made it difficult to communicate the results of the programs. As a result, several strategies were integrated throughout the grant-making lifecycle including: grantee orientation meetings, project planning and monitoring tools, and evaluation guidance.

Key to this approach is the Global Impact Chart (GIC), a tracking form designed to capture outputs and outcomes per grantee intervention. By matching project activities with relative GIC measurements, focused data collection limits the amount of data reported outside the project scope.

To date, benefits derived from this new model include: improved accuracy in reporting outcomes and outputs across projects in multiple countries; greater capacity and translation of learned evaluation skills by grantees; and increased ability for Komen to measure the impact of the programs and make data-driven cost-effective funding decisions. All of which contribute to long-term sustainability.

Based on the initial success of the OBE model in the global setting, Komen is replicating a similar framework within its national and international grant-making platform.