Evaluation Tool and Methodology for Cross-Cultural Prevention and Early Intervention Behavioral Health Programs

Alameda County Behavioral Health Care Services (ACBHCS) has developed a methodology that demonstrates validity when evaluating prevention programs serving multiple cultures. This presentation will describe the methodology, share the evaluation tool and explain the benefits of participatory methods in outcome measure development. California's Mental Health Services Act (MHSA) (2004) allocates 20% of county funding to Prevention and Early Intervention (PEI) services. ACBHCS uses a portion of its MHSA/PEI funds to contract with eight culturally-responsive prevention programs that provide mental health services to underserved and unserved ethnic minorities (Native American, Asian and Pacific Islander, Latino, Afghan, South Asian, and refugee communities).

From the outset, BHCS administration and the leadership of these prevention programs were committed to developing a cross-cultural evaluation methodology using a participatory approach. The evaluation team used a series of participatory decision-making methods to engage the providers in two tasks. First, identify a logic model describing: common program design elements; and short-term, intermediate and long-term outcomes across the eight projects. Second, develop an evaluation tool that accurately measures the impact of culturally responsive PEI services across the following domains: connecting individuals and families with their culture; forming and strengthening identity; changing individual knowledge and perception of mental health services; building community and wellness; and improving access to services and resources.

By documenting how these services impact individuals and families we hope to show the integral role of prevention services in the continuum from prevention/early intervention through treatment and recovery.