243333 Collecting and Reporting Results: Systematizing the Identification & Dissemination of “Best Practices” in Evaluation Planning and Intervention Effectiveness

Tuesday, November 1, 2011: 5:30 PM

Oscar J. Espinosa, MA , Public Health Research Department, NORC at the University of Chicago, Bethesda, MD
Performance measurement systems are widely used by organizations in both the public and private sectors, with the objective of improving decision- making and overall performance. These systems are only as good as their ability to provide users with timely and accurate information to make better, more informed decisions. This presentation focuses on OMH's procedures and protocols for reporting and utilizing the results generated by its performance improvement and management system (PIMS). The various topical reports generated from data submitted by OMH-funded grantees via OMH's web-based Performance Data System (PDS), (such as reports on efficiency, effectiveness, contributions to NPA goals and Healthy People objectives, extent of strategic planning, partnership development, and more specific outcomes of their evaluations) will be presented. The presentation will include descriptions of the systematic, unbiased review and assessment protocols developed and followed by OMH to identify grantees that have developed and applied exemplary evaluation planning practices as well as protocols developed to identify grantees who are reporting credible evidence of intervention effectiveness through their evaluation efforts. A collection of strategies and interventions that are proven to work through the application of these protocols will be discussed, along with how OMH is using these findings to recommend to future grantees evaluation planning strategies that should be adopted, fund and recommend interventions that are likely to produce results, make strategic decisions about future funding strategies, and inform the knowledge base of what works in regards to interventions focused on reducing and eliminating racial and ethnic health disparities.

Learning Areas:
Conduct evaluation related to programs, research, and other areas of practice
Systems thinking models (conceptual and theoretical models), applications related to public health

Learning Objectives:
1. Describe the content of data reports generated by the PDS and how they inform OMH’s performance reporting requirements and decision making process. 2. Identify at least two examples of ‘best practices’ in evaluation planning and/or intervention effectiveness and describe the protocol used for their selection

Keywords: Evaluation, Evidence Based Practice

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I currently lead a project that collects and reports performance data for an HHS office.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.