258732 Improving web-based alcohol behavior interventions targeting college students: Assessment of process evaluation

Monday, October 29, 2012

Adam Knowlden, CHES, MBA, MS , Health Promotion & Education Program, University of Cincinnati, Cincinnati, OH
Manoj Sharma, MBBS, MCHES, PhD , Health Promotion & Education, University of Cincinnati, Cincinnati, OH
Issues: Program fidelity is a critical component of intervention evaluation. Web-based interventions have become increasingly popular in recent years due to their cost-effectiveness and high reach potential. The purpose of this investigation was to synthesize process evaluation methodology of web-based interventions targeting alcohol behaviors of college students. Description: Data were extracted from studies published in CINAHL, ERIC, MEDLINE, and Psychology and Behavioral Sciences Collection. Abstracts were reviewed independently by two investigators applying the following inclusion criteria: (1) web-based, (2) alcohol behavior interventions, (3) of quantitative design that (4) targeted college students, (5) between 2000 and 2012, and (6) incorporated process evaluation. Lessons Learned: Inclusion criteria were met by nine interventions. A large portion of excluded studies were brief interventions devoid of any process evaluation. Of the studies analyzing process evaluation, most were limited to participant satisfaction and perceived usefulness of the intervention. Among studies gauging fidelity, log-in codes, date and duration of activity, portions of web-site visited, forced-response validation, reminder e-mails, and complementary protocol packets were the most frequently utilized modalities. Recommendations: To assess the efficacy of web-based programs researchers must begin building substantive implementation process evaluation into both brief and full interventions. While participant satisfaction is important, the true value of process evaluation lies in the ability to gauge accuracy of program delivery. Among interventions that did evaluate implementation, analysis was primarily limited to data mining. Current process evaluation practices provide minimal ability to gauge fidelity of program delivery. Strategies for including fidelity evaluation into web-based environments are provided.

Learning Areas:
Administer health education strategies, interventions and programs
Conduct evaluation related to programs, research, and other areas of practice
Implementation of health education strategies, interventions and programs
Planning of health education strategies, interventions, and programs
Program planning
Public health or related research

Learning Objectives:
Upon completion of this presentation the participants will be able to: 1.Discuss the importance of incorporating program fidelity into process evaluation. 2.Differentiate between process evaluation focusing on participant satisfaction and process evaluation focusing on program fidelity. 3.Design a web-based intervention for modifying drinking behaviors that incorporates several layers of implementation process evaluation.

Keywords: Alcohol, College Students

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I have conceptualized the study, developed the inclusion criteria, collected the data, and analyzed the data along with my coauthor.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.

Back to: 3076.0: ATOD Student Poster Showcase