141st APHA Annual Meeting

In This section

283953
Automated biosurveillance: Searching for aberration detection algorithms with robust detection performance

Tuesday, November 5, 2013

Hong Zhou, MS. MPH, , Division of Notifiable Diseases and Healthcare Information, Centers for Disease Control and Prevention, Atlanta, GA
Howard Burkom, PhD , Johns Hopkins University Applied Physics Laboratory, Laurel, MD
Achintya Dey, MA , Division of Notifiable Diseases and Healthcare Information, Centers for Disease Control and Prevention, Atlanta, GA
Loren Akaka, RS, MPH , Centers for Disease Control and Prevention, Atlanta, GA
Paul Mcmurray, MDS , Centers for Diease Control and Prevention, Atlanta, GA
William W. Thompson, PhD , NCCDPHP, Division of Population Health, Arthritis, Epilepsy, and Quality of Life Branch, Centers for Disease Control and Prevention, Atlanta, GA
Umed Ajani, MBBS, MPH , Centers for Disease Control and Prevention, Atlanta, GA
Background: Use of robust and broadly applicable statistical alerting methods is essential for a public health syndromic surveillance system, such as CDC BioSense program.

Methods: Excess visit counts (at least two standard deviations above calculated baseline expectations) were artificially injected into gastrointestinal (GI) syndrome-related daily aggregate time series data from the BioSense Syndromic Surveillance system. Algorithm sensitivity was calculated as the ratio of days with injects for which the algorithm value exceeded a computed threshold. We compared these sensitivities among the three adaptive methods: a CUSUM (CS) chart and two Shewhart chart variations based on sums and ratios (C2a, C2b) adjusted for total visits. We also examined overall sensitivities before and after stratification by weekday versus weekend and holiday with different background ratios to total visits that are GI-related.

Results: At a daily background alert rate of 5% and 1%, the sensitivities ranged between 31%-79% and 10%-64%, respectively. Sensitivities were, in general, higher for CS and C2a and lower for C2b. However, the overall sensitivity for C2b increased significantly after stratification by weekday/weekend and holiday.

Conclusions: CS and C2a performed better than C2b for detection of short signals in GI-related visit series. These analyses demonstrated that sensitivity can be improved overall if day-of-week differential in background ratio to total visits is taken into account. Further analyses using time-series from additional syndromes and multi-day signal shapes to allow timeliness comparisons will be presented.

Learning Areas:
Biostatistics, economics

Learning Objectives:
Explain the importance of appropriate aberrancy-detection algorithms applied in the automated public health surveillance system. Compare various aberrancy-detection algorithms. Demonstrate the methodologies of algorithm selections.

Keywords: Biostatistics, Methodology

Presenting author's disclosure statement:

Qualified on the content I am responsible for because: I have been the lead researcher of multiple projects on the application of statistical methods in infectious disease surveilance and automated biosurveillance systems.
Any relevant financial relationships? No

I agree to comply with the American Public Health Association Conflict of Interest and Commercial Support Guidelines, and to disclose to the participants any off-label or experimental uses of a commercial product or service discussed in my presentation.