241656 Performance assessment – objective and quantified results rapidly and ready when you need them

Monday, October 31, 2011

Susan J. Griffey, DrPH, BSN, FNP , Evaluation Center, Public Health Research Group, Social & Scientific Systems, Inc, Silver Spring, MD
Mary Pat Selvaggio, MPH, BS , Director of Health Division, Khulisa Management Services, Johannesburg, South Africa
Doug Franke, CPA, BBA , Managing Director, SustainAbility Solutions Africa (SSA), Gardenview, South Africa
Edna Berhane, MPH, MIA , Associate Director, Health Division, Khulisa Management Services, Johannesburg, South Africa
Managers and clients need information on how programs are functioning - beyond that which is available from monitoring and information systems. Even with committed parties, an evaluation can be burdensome for both the client and program. It takes time to develop and implement the evaluation, and getting timely and useful results afterward often lags. Performance Assessment (PA) fills the need for rapid and objective information. We developed a standards-based PA to deliver objective and quantified results available immediately. In South Africa, we implemented a multi-module PA tool (PAT) with a unifying conceptual framework for assessing technical areas. This brought uniformity in assessing what may seem to be very diverse public health programs that a single organization implements. Whether assessing one or many programs within an organization, the results are a comprehensive picture of each program and not just focused on service delivery. A more comprehensive organizational assessment can be done when the PA is broadened to include the modules for assessing cross-cutting areas. The Excel-based PAT automatically produces quantitative performance scores on the functional areas and locations assessed as soon as data is entered -- in Stoplight Scoring Tables (by location-assessed and module subsections) and in Bar Graphs of overall performance (across module subsections). These identify at a glance the areas of program strengths and weaknesses. With standards-based results, clients have immediate information for focusing remediation and performance improvement (PI) interventions. The PA results from assessing more than 30 organizations have shown the flexibility for assessing programs in very diverse organizations while ensuring objectivity in measurement. These results are important to funders; concomitantly, the organizations themselves have identified the usefulness of the standards-based tool and have requested this for their internal PI efforts. Since this PA approach is standards-based, it is readily adaptable to a variety of programs and organizations.

Learning Areas:
Administration, management, leadership
Conduct evaluation related to programs, research, and other areas of practice
Program planning
Public health or related organizational policy, standards, or other guidelines
Public health or related research
Systems thinking models (conceptual and theoretical models), applications related to public health

Learning Objectives:
Identify the role of Performance Assessment in the evaluation continuum and define the types of program-performance results derived from it

Keywords: Evaluation, Performance Measurement

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I developed the conceptual approach to performance assessment (PA), designed the data collection tool, have developed the performance assessment methodology, have trained PA assessors, have provided implementation guidance during data collection, and serve as a quality control reveiwer of assessor reports.
Any relevant financial relationships? Yes

Name of Organization Clinical/Research Area Type of relationship
Khulisa Management Services Evaluation Independent Contractor (contracted research and clinical trials) and We have received funding from CDC for this work

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.