246811 Effectiveness of National TB Program's monitoring and evaluation system in Papua New Guinea: An onsite data verification at service delivery points

Wednesday, November 2, 2011: 9:06 AM

John-Michael May, MPH , Healthcare Practice, Cardno Emerging Markets USA, Ltd., Arlington, VA
This presentation outlines methodologies used to evaluate the Monitoring & Evaluation (M&E) system of the Papua New Guinea National Department of Health (NDOH) National TB Program (NTP). This presentation highlights findings of an Onsite Data Verification (OSDV) at service delivery points, which reveals a disconnect between what is outlined in the NTP M&E plan and what is actually happening on the ground. The NDOH, as a Global Fund grant recipient, must report performance against programmatic indicator targets. The Global Fund mobilizes the Local Fund Agent (LFA) to go to service delivery points and conduct an OSDV to confirm reported programmatic performance. For the OSDV the LFA utilizes a bottom-up audit trail approach reviewing data in primary records, and for a point of comparison, aggregated provincial summary reports within a specified reporting period. Redundancies in information flows and unnecessary parallel reporting systems in the NDOH were identified by the LFA as data collection constraints and resulting in an increased potential for human error. Poor harmonization among NTP partners (World Vision and JTAI) due to lack of familiarity with the NTP M&E strategy was noted as a fundamental implementation challenge. Coordination amongst NDOH staff as well as between NTP partners must occur so accurate data can be collected and reported in a timely fashion. The presentation will conclude with an analysis of lessons learned.

Learning Areas:
Other professions or practice related to public health

Learning Objectives:
Attendees of this presentation will be able to explain to others evaluation approaches used by the Local Fund Agent to assess the Monitoring and Evaluation system of a Global Fund grant recipient.

Keywords: Information Systems, Performance Measurement

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am qualified to present because: Mr. John-Michael May is a development practitioner with over three years of experience in monitoring and program performance evaluation and nearly six year of capacity development experience in both the public and private sector. At Cardno Emerging Markets USA, Ltd. within the Healthcare Practice Unit, Mr. May manages USIAD and Global Fund projects and conducts technical assignments in capacity assessment and systems strengthening. Mr. May has an in-depth understanding of the Global Fund’s performance based funding approach to development. As a Local Fund Agent Project Manager for the Global Fund he has conducted onsite evaluations of grantees in Papua New Guinea, Guyana, and Trinidad and Tobago. Mr. May has given presentations at several international conferences, including the World Federation of Public Health Associations’ World Congress in Istanbul, Turkey and the American Public Health Association Annual Meeting in Philadelphia. Mr. May holds a Masters in Public Health from The George Washington University.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.