142nd APHA Annual Meeting and Exposition

Annual Meeting Recordings are now available for purchase

305329
Balancing anonymity and analytic value in surveys of patients in vulnerable populations: The mathematics and logic of selecting and coding variables to control risk while maximizing information from CAHPS surveys in a large urban Medicaid health plan, 2008-2013

142nd APHA Annual Meeting and Exposition (November 15 - November 19, 2014): http://www.apha.org/events-and-meetings/annual
Wednesday, November 19, 2014 : 9:30 AM - 9:50 AM

S. Rae Starr, MPhil, MOrgBehav , HealthCare Outcomes & Analysis, L.A. Care Health Plan, Los Angeles, CA
Public agencies and health plans rely heavily on live surveys of anonymous patients to assess the quality of services. Anonymity protects patients, but also limits the ability to identify and fix sources of poor health care.  Conventional approaches restrict data by type -- severely aggregating key analytic variables such as provider group or medical condition; and restrict important demographics such as ethnicity, and geographical area (needed in analysis because “where you live affects your health and well-being”).  This paper reports rational methods to calculate and limit risk to patients in limited (but still usable) data sets.

(a) Importance of tradeoffs between anonymity and actionability: Anonymity protects patients from overt retaliation or inadvertent harm from providers they are rating. But anonymity limits the ability to drill down in the data to target corrective actions or address disparities. 

(b) Applied example: This paper reports implications of common anonymity rules for surveys in a large and diverse community-affiliated Medicaid health plan from 2008 to 2013, evaluating services in a complex, dispersed provider network.  Analytically important member and provider characteristics are discussed, with methods to render those variables safer.   

(c) Quantitative and qualitative factors: The presentation explains the calculation of the risk of breaching anonymity, noting examples of misapplied or ambiguous anonymity rules.  Qualitative factors (types of risks, degrees of anonymity) are also discussed as parameters in choosing which demographics to request in anonymous datasets.  Methods are briefed for single surveys; and adaptions for multi-year survey databases used in continuous quality improvement (CQI).

Learning Areas:

Biostatistics, economics
Conduct evaluation related to programs, research, and other areas of practice
Ethics, professional and legal requirements
Implementation of health education strategies, interventions and programs
Planning of health education strategies, interventions, and programs
Public health or related laws, regulations, standards, or guidelines

Learning Objectives:
Explain the importance of anonymity in surveys of populations particularly vulnerable to disclosure. Describe the tradeoffs between anonymity and applied value to make health care surveys actionable. Discuss analytic limitations imposed by common rules for protecting anonymity. Describe qualitative and quantitative factors that drive the risk of breaching anonymity. Describe specific risks from releasing various demographics in response data from surveys. Discuss degrees of anonymity and their appropriate application. Explain the calculation of risks to anonymity in common demographics. Identify factors that play into the calculation of risk against a predetermined threshold. Describe best (and worst) practices for using anonymous and non-anonymous data from vulnerable populations. Discuss how to adapt from a one-shot survey context into a multi-year data strategy for quality improvement analyses.

Keyword(s): Survey, Privacy

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: Served eight years as Senior Biostatistician at the largest public health plan in the United States, serving Medicaid and Medicare populations in an ethnically diverse urban county. Managed CAHPS survey from 2006 to 2013 to obtain data and analyze for actionable information to guide the design of interventions to improve the quality of services and care. Negotiated detailed data release and privacy agreements with survey firms, using methods and concepts pertinent to the abstract.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.