Large, James and Bagnall, Anthony (2019) Mixing hetero- and homogeneous models in weighted ensembles. In: 20th International Conference on Intelligent Data Engineering and Automated Learning. Lecture Notes in Computer Science . Springer, pp. 129-136. ISBN 978-3-030-33606-6
Preview |
PDF (MixingCAWPE)
- Accepted Version
Download (674kB) | Preview |
Abstract
The effectiveness of ensembling for improving classification performance is well documented. Broadly speaking, ensemble design can be expressed as a spectrum where at one end a set of heterogeneous classifiers model the same data, and at the other homogeneous models derived from the same classification algorithm are diversified through data manipulation. The cross-validation accuracy weighted probabilistic ensemble is a heterogeneous weighted ensemble scheme that needs reliable estimates of error from its base classifiers. It estimates error through a cross-validation process, and raises the estimates to a power to accentuate differences. We study the effects of maintaining all models trained during cross-validation on the final ensemble's predictive performance, and the base model's and resulting ensembles' variance and robustness across datasets and resamples. We find that augmenting the ensemble through the retention of all models trained provides a consistent and significant improvement, despite reductions in the reliability of the base models' performance estimates.
Item Type: | Book Section |
---|---|
Faculty \ School: | Faculty of Science > School of Computing Sciences |
UEA Research Groups: | Faculty of Science > Research Groups > Data Science and Statistics |
Depositing User: | LivePure Connector |
Date Deposited: | 13 Sep 2019 00:08 |
Last Modified: | 21 Apr 2023 01:45 |
URI: | https://ueaeprints.uea.ac.uk/id/eprint/72158 |
DOI: | 10.1007/978-3-030-33607-3_15 |
Downloads
Downloads per month over past year
Actions (login required)
View Item |