Machine learning to refine decision making within a syndromic surveillance service

Lake, Iain R. ORCID: https://orcid.org/0000-0003-4407-5357, Colon Gonzalez, Felipe De Jesus, Barker, Gary C., Morbey, Roger A., Smith, Gillian E. and Elliot, Alex J. (2019) Machine learning to refine decision making within a syndromic surveillance service. BMC Public Health, 19. ISSN 1471-2458

Preview

PDF (Lake_etal_BMCPublicHealth_2019) - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

Background: Worldwide, syndromic surveillance is increasingly used for improved and timely situational awareness and early identification of public health threats. Syndromic data streams are fed into detection algorithms, which produce statistical alarms highlighting potential activity of public health importance. All alarms must be assessed to confirm whether they are of public health importance. In England, approximately 100 alarms are generated daily and, although their analysis is formalised through a risk assessment process, the process requires notable time, training, and maintenance of an expertise base to determine which alarms are of public health importance. The process is made more complicated by the observation that only 0.1% of statistical alarms are deemed to be of public health importance. Therefore, the aims of this study were to evaluate machine learning as a tool for computer-assisted human decision-making when assessing statistical alarms. Methods: A record of the risk assessment process was obtained from Public Health England for all 67505 statistical alarms between August 2013 and October 2015. This record contained information on the characteristics of the alarm (e.g. size, location). We used three Bayesian classifiers- naïve Bayes, tree-augmented naïve Bayes and Multinets - to examine the risk assessment record in England with respect to the final ‘Decision’ outcome made by an epidemiologist of ‘Alert’, ‘Monitor’ or ‘No-action’. Two further classifications based upon tree-augmented naïve Bayes and Multinets were implemented to account for the predominance of ‘No-action’ outcomes. Results: The attributes of each individual risk assessment were linked to the final decision made by an epidemiologist, providing confidence in the current process. The naïve Bayesian classifier performed best, correctly classifying 51.5% of ‘Alert’ outcomes. If the ‘Alert’ and ‘Monitor’ actions are combined then performance increases to 82.6% correctly classified. We demonstrate how a decision support system based upon a naïve Bayes classifier could be operationalised within an operational syndromic surveillance system. Conclusions: Within syndromic surveillance systems, machine learning techniques have the potential to make risk assessment following statistical alarms more automated, robust, and rigorous. However, our results also highlight the importance of specialist human input to the process.

Item Type:	Article
Uncontrolled Keywords:	sdg 3 - good health and well-being ,/dk/atira/pure/sustainabledevelopmentgoals/good_health_and_well_being
Faculty \ School:	Faculty of Science > School of Environmental Sciences University of East Anglia Research Groups/Centres > Theme - ClimateUEA
UEA Research Groups:	University of East Anglia Schools > Faculty of Science > Tyndall Centre for Climate Change Research Faculty of Science > Research Centres > Tyndall Centre for Climate Change Research Faculty of Science > Research Groups > Environmental Social Sciences
Depositing User:	LivePure Connector
Date Deposited:	03 May 2019 09:30
Last Modified:	20 Mar 2023 14:45
URI:	https://ueaeprints.uea.ac.uk/id/eprint/70811
DOI:	10.1186/s12889-019-6916-9

Downloads

Actions (login required)

View Item