Machine learning calibration of low-cost NO2 and PM10 sensors: non-linear algorithms and their impact on site transferability

Nowack, Peer ORCID:, Konstantinovskiy, Lev, Gardiner, Hannah and Cant, John (2021) Machine learning calibration of low-cost NO2 and PM10 sensors: non-linear algorithms and their impact on site transferability. Atmospheric Measurement Techniques, 14 (8). pp. 5637-5655. ISSN 1867-1381

[thumbnail of Published_Version]
PDF (Published_Version) - Published Version
Available under License Creative Commons Attribution.

Download (7MB) | Preview


Low-cost air pollution sensors often fail to attain sufficient performance compared with state-of-the-art measurement stations, and they typically require expensive laboratory-based calibration procedures. A repeatedly proposed strategy to overcome these limitations is calibration through co-location with public measurement stations. Here we test the idea of using machine learning algorithms for such calibration tasks using hourly-averaged co-location data for nitrogen dioxide (NO2) and particulate matter of particle sizes smaller than 10 µm (PM10) at three different locations in the urban area of London, UK. We compare the performance of ridge regression, a linear statistical learning algorithm, to two non-linear algorithms in the form of random forest regression (RFR) and Gaussian process regression (GPR). We further benchmark the performance of all three machine learning methods relative to the more common multiple linear regression (MLR). We obtain very good out-of-sample R2 scores (coefficient of determination) >0.7, frequently exceeding 0.8, for the machine learning calibrated low-cost sensors. In contrast, the performance of MLR is more dependent on random variations in the sensor hardware and co-located signals, and it is also more sensitive to the length of the co-location period. We find that, subject to certain conditions, GPR is typically the best-performing method in our calibration setting, followed by ridge regression and RFR. We also highlight several key limitations of the machine learning methods, which will be crucial to consider in any co-location calibration. In particular, all methods are fundamentally limited in how well they can reproduce pollution levels that lie outside those encountered at training stage. We find, however, that the linear ridge regression outperforms the non-linear methods in extrapolation settings. GPR can allow for a small degree of extrapolation, whereas RFR can only predict values within the training range. This algorithm-dependent ability to extrapolate is one of the key limiting factors when the calibrated sensors are deployed away from the co-location site itself. Consequently, we find that ridge regression is often performing as good as or even better than GPR after sensor relocation. Our results highlight the potential of co-location approaches paired with machine learning calibration techniques to reduce costs of air pollution measurements, subject to careful consideration of the co-location training conditions, the choice of calibration variables and the features of the calibration algorithm.

Item Type: Article
Uncontrolled Keywords: air pollution,low-cost sensors,machine learning,calibration,atmospheric chemistry,nitrogen dioxide,particulate matter,air quality,measurement techniques,pm10,no2,atmospheric science,sdg 11 - sustainable cities and communities ,/dk/atira/pure/subjectarea/asjc/1900/1902
Faculty \ School: Faculty of Science > School of Environmental Sciences
UEA Research Groups: Faculty of Science > Research Groups > Centre for Ocean and Atmospheric Sciences
Faculty of Science > Research Groups > Climatic Research Unit
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 15 Jul 2021 00:19
Last Modified: 15 Jun 2023 00:09
DOI: 10.5194/amt-14-5637-2021


Downloads per month over past year

Actions (login required)

View Item View Item