227294 Innovative use state school-based survey data to evaluate and sustain programs

Wednesday, November 10, 2010 : 12:30 PM - 12:50 PM

Tracy Keenan, MSW, PPSC , Applied Survey Research, Watsonville, CA
ASR was hired to evaluate the Safe Schools/Healthy Students (SS/HS) project in the Pajaro Valley Unified School District (PVUSD). PVUSD provides K-12 education to over 19,000 students, the majority of whom are Latino (79%) and from very low-income families. One hallmark of the evaluation was the innovative analysis of state school-based survey (California Healthy Kids Survey – CHKS) data. ASR looked in-depth at at-risk behaviors and protective factors that help youth avoid these behaviors. Cluster analyses showed that over the grant period student assets increased, meaning more students felt connected to adults, were involved in meaningful opportunities, and felt engaged/ empowered at school. An algorithm was created based on these clusters to identify whether at-risk cluster groups decreased over time. These high/ low risk and resiliency profiles were linked to program outcomes and specific interventions. Evaluation findings showed that high school students reported less ATOD use, perceived that frequent ATOD use was more harmful than at the start of the project, and students perceived that schools were safer than before. Further, state school-based survey data was used to compare PVUSD to the county overall, excluding PVUSD data, in order to disaggregate the trends in key outcome areas in PVUSD as compared to the rest of the county. This data would allow further analysis into the effects of the program. Data was also used to drive and sustain SS/HS programs, as well as tailor future programs to youth relevant to their strengths and challenges. Methodology approved by ASR's Internal Review Board.

Learning Areas:
Conduct evaluation related to programs, research, and other areas of practice
Program planning
Public health or related education
Public health or related research
Social and behavioral sciences

Learning Objectives:
1. Describe an innovative use of state school-based survey data analysis for program evaluation and project sustainability. 2. Describe how cluster analysis was used to identify profiles of student respondents based on their strengths and at-risk behaviors. 3. Describe the use of state school-based survey data to disaggregate trends in the school district compared to the rest of the county. 4. Describe a data collection and analysis methodology for evaluation that may be used in other communities.

Keywords: Evaluation, School-Based Programs

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am a researcher for a non-profit community based social research firm and was the independent evaluator for the project discussed.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.