243485 Facilitating Results: A Coordinated Approach to Measuring Performance and Delivering Standardized Evaluation Training and Technical Assistance

Tuesday, November 1, 2011: 4:50 PM

Jennifer Benz, PhD , Public Health Research Department, NORC at the University of Chicago, Marblehead, MA
Shamis Mohamoud, MA , Public Health Research Departmen, NORC at the University of Chicago, Bethesda, MD
This presentation will describe the methods used to assess OMH grantees' evaluation needs and to provide standardized evaluation training and technical assistance. PIMS trainers engage with grantees early to strengthen their evaluation plans and increase evaluation knowledge and capacity. The presentation will cover the types of interventions PIMS trainers are utilizing to assist grantees with planning and monitoring the implementation of their evaluations. Common topics include the selection of outcomes-focused performance measures, timing data collection activities, and ensuring consistency between programmatic and evaluative activities and goals. The goal of these activities, which include assessment and technical assistance at the individual grantee and grant program levels, is to increase the quality and similarity of individual grantee performance indicators thereby allowing OMH to better assess its progress toward achieving office- and department-wide goals. The presentation will provide examples of improvements made to the grantees' evaluations after receiving training and technical assistance; will highlight challenges and successes that the grantees faced; and will provide some suggestions for best practices in helping organizations transition to more outcomes-focused performance measures. In addition, tools and resources will be described that are designed to promote systematic program design, planning, performance measurement, data collection, and evaluation; and to help assess the effectiveness of minority health and health disparities-related interventions. These include a searchable database of performance measures that permits users to identify and select indicators for outcomes or impacts related to minority health and health disparities.

Learning Areas:
Conduct evaluation related to programs, research, and other areas of practice
Public health administration or related administration
Public health or related organizational policy, standards, or other guidelines
Public health or related research

Learning Objectives:
1. List common evaluation barriers faced by grantees and training and TA strategies designed to overcome them. 2. Identify different tools and resources that are or will be available to OMH grantees and other stakeholders for program planning and evaluation purposes.

Keywords: Evaluation, Evidence Based Practice

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I serve as the lead evaluation trainer for OMH grantees, as well as having expertise in performance measurement and evaluation.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.