Conducting quasi-experimental evaluation research in the real world: Evaluating the community transformation grant's smoke-free multi-unit housing initiative

Background:  During Fall, 2011, the US Centers for Disease Control and Prevention awarded the Community Transformation Grant (CTG) which seeks to build community capacity to prevent chronic disease.  Funds support communities as they pursue evidence-based strategies to prevent obesity, reduce tobacco use, and improve screening for high blood pressure and cholesterol.  Wisconsin was awarded a five-year CTG.

Wisconsin's initiative focuses on changing systems and policies that create opportunities to make healthy choices in three important areas: tobacco-free living, healthy food systems, and active communities.  Thirty Wisconsin communities (grantees) are receiving funding to support these efforts.  In total, the projects will reach more than 2.6 million people in Wisconsin, or about half of the state’s population.  The purpose of this session is to share the evaluation research being conducted in the tobacco-free living arm of the initiative.

The Evaluation:  The evaluation consists of a quasi-experimental design, with a treatment group (communities that are being targeted for intervention as part of the CTG project) and a comparison group (matched communities that are not part of the CTG project).  Baseline and follow-up data collection are being conducted via telephone interviews, mailed surveys, and performance-based instruments completed by grantees in each targeted community.

This session will discuss the research design, data collection instruments, and baseline findings of the evaluation.  Strengths and challenges associated with various aspects of the evaluation will be shared, along with lessons learned and strategies for dealing with the challenges associated with conducting program evaluation research in the real world.