Online Program

Advancing consumers' role in reporting electronic health data quality assessments

Monday, November 2, 2015

Juliana Barnard, MA, Adult and Child Consortium for Health Outcomes Research and Delivery Science, Department of Pediatrics, University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, CO
Marianne Hamilton-Lopez, PhD, MPA, Academy Health, Washington, DC
Erin Holve, PhD, MPH, MPP, Academy Health, Washington, DC
Elaine Morrato, DrPH, MPH, Colorado School of Public Health, University of Colorado Denver Anschutz Medical Campus, Aurora, CO
Michael G. Kahn, MD, PhD, Pediatrics, University of Colorado Denver Anschutz Medical Campus, Aurora, CO

Poor data quality in electronic health records (EHRs) can threaten the validity of study results thereby affecting personal and policy decision-making by different consumers of the information.  We engaged stakeholders representing patient-advocates and policy-makers to guide the creation of data quality assessment (DQA) reporting standards that includes these data consumers’ perspectives.


Inform proposed DQA reporting standards through data consumer stakeholder feedback.   


Qualitative methods were used to moderate a stakeholder engagement meeting as part of a patient-centered project on data quality and transparency. The discussion guide used broad, open-ended questions and prompts to elicit stakeholders’ perceptions of their members’ concerns about, interest in, and opportunities for engagement in DQA reporting.  Stakeholders included representatives from nonprofit public policy or professional organizations, federal government agencies, and patient advocacy groups.  Data were analyzed using qualitative content methods and reflexive team analysis.


The stakeholders (n=21) expressed a strong interest in DQA and reporting.  They desired significant engagement at initial data collection and analysis stages as well as at later-stage categorizing, analyzing, and reporting of DQA findings.   Patient-advocacy stakeholders believed that engagement at data point-of-capture is critical to improved data accuracy and clinical decision-making.  Policy-makers identified medical providers’ distrust of data accuracy in EHRs as a significant barrier to secondary use of data sets (for comparative effectiveness research, benchmarking, or Meaningful Use).   Potential solutions identified included changing data capture systems to include individual-level review.  All stakeholders believed facilitation of review of DQAs, and dissemination and implementation of DQA results, are unique roles they can have in DQA and reporting. 


The stakeholders’ feedback suggests the addition of individual-level review of data and value of broadening the participating communities in developing DQA reporting standards.  Making DQA results accessible to data consumers may increase confidence in data reuse for research, health, and policy purposes.

Learning Areas:

Communication and informatics

Learning Objectives:
Identify the value of engaging data consumer stakeholders in development of data quality assessment reporting standards. Discuss the barriers to patient-advocate and policy-maker engagement in data quality assessment and reporting. Describe the suggested changes to data capture systems that could increase individual-level engagement in data quality assessment and reporting.

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I am the investigator of the data quality assessment and reporting project with expertise in qualitative methods and analysis. I have lead multiple health research projects in which we engage many types of stakeholder groups to inform health care assessment and delivery systems.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.