The 130th Annual Meeting of APHA |
Mark Andrew Tesoro, MA1, Shaheen Halim, PhD2, Philip Renner, MBA1, and James Shaul, MHA3. (1) Measures Development, National Committee for Quality Assurance (NCQA), 2000 L St., N.W., Suite 500, Washington, DC 20036, (202) 955-1731, tesoro@ncqa.org, (2) Research & Analysis, National Committee for Quality Assurance (NCQA), 2000 L St., N.W., Suite 500, Washington, DC 20036, (3) Department of Health Care Policy, Harvard Medical School, 180 Longwood Avenue, Boston, MA 02115
Collecting survey data via the Internet has the potential to reduce the costs associated with traditional survey data collection methods. Multiple rounds of mailings and the utilization of computer assisted telephone interviews (CATI) have proven to be effective but costly methods of fielding surveys. A successful Internet administration of the ECHO survey would support the feasibility and possibly encourage future use of such data collection methods. Three methodologies were utilized in this study, the standard HEDIS CAHPS 2.0H “Mail then Phone” method and two Internet administration methodologies, an “Internet 1st then Mail” and “Mail plus Internet Option”. Three MBHOs representing a cross-section of the MBHO industry participated. For each MBHO a total sample of 800 users of mental or behavioral health services were drawn and randomly assigned to one of the three protocols. Individuals were more likely to complete the survey by the Internet using the “Internet 1st then Mail” protocol, yet the response rates were lower for this protocol (13.4%) than for “Mail then Phone” (33.4%) and “Mail plus Internet Option” (24.6%). We do not see any evidence to suggest that using the Internet as a response mode introduces a response bias. The use of the Internet combined with mailed surveys did not increase the response rate beyond that achieved by a Mixed Mail/Telephone protocol. However, if methods can be designed to overcome the response rate issues discussed above, the Internet can be used to gather responses in a manner that may reduce cost or burden without compromising confidentiality.
Learning Objectives: “At the conclusion of the session, the participant in this session will be able to
Keywords: Survey, Mental Health Services
Related Web page: www.hcp.med.harvard.edu/echo/
Presenting author's disclosure statement:
I have a significant financial interest/arrangement or affiliation with any organization/institution whose products or services are being discussed in this session.
Relationship: employer