Comparison of statistical algorithms for daily syndromic surveillance aberration detection

Noufaly, Angela, Morbey, Roger A, Colón-González, Felipe J, Elliot, Alex J, Smith, Gillian E, Lake, Iain R and McCarthy, Noel (2019) Comparison of statistical algorithms for daily syndromic surveillance aberration detection. Bioinformatics, 35 (17). 3110–3118. ISSN 1367-4803

[img] PDF (Supplementary data) - Submitted Version
Restricted to Repository staff only until 31 December 2099.

Download (156kB) | Request a copy
[img] PDF (Accepted manuscript) - Submitted Version
Restricted to Repository staff only until 31 December 2099.

Download (1MB) | Request a copy
[img]
Preview
PDF (DaTM_Npufaly_etal_2019) - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract

Motivation: Public health authorities can provide more effective and timely interventions to protect populations during health events if they have effective multi-purpose surveillance systems. These systems rely on aberration detection algorithms to identify potential threats within large datasets. Ensuring the algorithms are sensitive, specific and timely is crucial for protecting public health. Here, we evaluate the performance of three detection algorithms extensively used for syndromic surveillance: the ‘rising activity, multilevel mixed effects, indicator emphasis’ (RAMMIE) method and the improved quasi-Poisson regression-based method known as ‘Farrington Flexible’ both currently used at Public Health England, and the ‘Early Aberration Reporting System’ (EARS) method used at the US Centre for Disease Control and Prevention. We model the wide range of data structures encountered within the daily syndromic surveillance systems used by PHE. We undertake extensive simulations to identify which algorithms work best across different types of syndromes and different outbreak sizes. We evaluate RAMMIE for the first time since its introduction. Performance metrics were computed and compared in the presence of a range of simulated outbreak types that were added to baseline data. Results: We conclude that amongst the algorithm variants that have a high specificity (i.e. ¿90%), Farrington Flexible has the highest sensitivity and specificity, whereas RAMMIE has the highest probability of outbreak detection and is the most timely, typically detecting outbreaks 2-3 days earlier. Availability and Implementation: R codes developed for this project are available through https://github.com/FelipeJColon/AlgorithmComparison

Item Type: Article
Additional Information: Supplementary data are available at Bioinformatics online
Faculty \ School: Faculty of Science > School of Environmental Sciences
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 04 Dec 2018 16:30
Last Modified: 19 May 2020 00:06
URI: https://ueaeprints.uea.ac.uk/id/eprint/69165
DOI: 10.1093/bioinformatics/bty997

Actions (login required)

View Item View Item