Process evaluation of teen tobacco grants: Using results to ensure accountability and implementation success

Process evaluation of 46 grants with similar objectives but different/varying implementation strategies is a challenge shared by state, regional and national public health funding organizations. As states become increasingly accountable for expenditure of state dollars, including MSA dollars, the need for timely and efficient grant monitoring is paramount. The NC Health and Wellness Trust Fund contracted with the University of North Carolina School of Medicine to provide both outcomes and process evaluation of the NC Teen Tobacco Prevention and Cessation Initiative. Using an indicator-based tracking system (iPTS) grantees provide monthly monitoring data including tobacco prevention education, youth empowerment, tobacco-free schools policy, reduction of youth exposure to secondhand smoke, reduction of health disparities, and youth smoking cessation. Grants monitors are able to capture activity reports for single or multiple programs, which can be matched with monthly expenditure reports for a comprehensive snapshot of grant activities. This complex system has allowed the funder to quickly identify technical assistance needs in addition to promoting grant successes. The data collection system has recently been translated to a web-based system, which will provide even faster access to data. This presentation will describe how the system has been used by local programs, state program and accounting staff, as well as the evaluation contractors in delivering a program that has seen a significant reduction in teen cigarette smoking behaviors.