The 130th Annual Meeting of APHA

4055.1: Tuesday, November 12, 2002 - Board 8

Abstract #44076

An Internet fielding of the Experience of Care and Health Outcomes (ECHOTM) behavioral health survey

Mark Andrew Tesoro, MA1, Shaheen Halim, PhD2, Philip Renner, MBA1, and James Shaul, MHA3. (1) Measures Development, National Committee for Quality Assurance (NCQA), 2000 L St., N.W., Suite 500, Washington, DC 20036, (202) 955-1731, tesoro@ncqa.org, (2) Research & Analysis, National Committee for Quality Assurance (NCQA), 2000 L St., N.W., Suite 500, Washington, DC 20036, (3) Department of Health Care Policy, Harvard Medical School, 180 Longwood Avenue, Boston, MA 02115

Collecting survey data via the Internet has the potential to reduce the costs associated with traditional survey data collection methods. Multiple rounds of mailings and the utilization of computer assisted telephone interviews (CATI) have proven to be effective but costly methods of fielding surveys. A successful Internet administration of the ECHO survey would support the feasibility and possibly encourage future use of such data collection methods. Three methodologies were utilized in this study, the standard HEDIS CAHPS 2.0H “Mail then Phone” method and two Internet administration methodologies, an “Internet 1st then Mail” and “Mail plus Internet Option”. Three MBHOs representing a cross-section of the MBHO industry participated. For each MBHO a total sample of 800 users of mental or behavioral health services were drawn and randomly assigned to one of the three protocols. Individuals were more likely to complete the survey by the Internet using the “Internet 1st then Mail” protocol, yet the response rates were lower for this protocol (13.4%) than for “Mail then Phone” (33.4%) and “Mail plus Internet Option” (24.6%). We do not see any evidence to suggest that using the Internet as a response mode introduces a response bias. The use of the Internet combined with mailed surveys did not increase the response rate beyond that achieved by a Mixed Mail/Telephone protocol. However, if methods can be designed to overcome the response rate issues discussed above, the Internet can be used to gather responses in a manner that may reduce cost or burden without compromising confidentiality.

Learning Objectives: “At the conclusion of the session, the participant in this session will be able to

Keywords: Survey, Mental Health Services

Related Web page: www.hcp.med.harvard.edu/echo/

Presenting author's disclosure statement:
I have a significant financial interest/arrangement or affiliation with any organization/institution whose products or services are being discussed in this session.
Relationship: employer

Mental Health Posters V: Co-Morbidity and Use of Mental Health Services

The 130th Annual Meeting of APHA