Khan, Z., Gul, A., Mahmoud, O.
ORCID: https://orcid.org/0000-0003-0342-6704, Miftahuddin, M., Perperoglou, A., Adler, W. and Lausen, B.
(2016)
An Ensemble of Optimal Trees for Class Membership probability estimation.
In:
Studies in Classification, Data Analysis, and Knowledge Organization.
UNSPECIFIED.
Abstract
Machine learning methods can be used for estimating the class membership probability of an observation. We propose an ensemble of optimal trees in terms of their predictive performance. This ensemble is formed by selecting the best trees from a large initial set of trees grown by random forest. A proportion of trees is selected on the basis of their individual predictive performance on out-of-bag observations. The selected trees are further assessed for their collective performance on an independent training data set. This is done by adding the trees one by one starting from the highest predictive tree. A tree is selected for the final ensemble if it increases the predictive performance of the previously combined trees. The proposed method is compared with probability estimation tree, random forest and node harvest on a number of bench mark problems using Brier score as a performance measure. In addition to reducing the number of trees in the ensemble, our method gives better results in most of the cases. The results are supported by a simulation study.
| Item Type: | Book Section |
|---|---|
| Faculty \ School: | Faculty of Medicine and Health Sciences > Norwich Medical School |
| Related URLs: | |
| Depositing User: | LivePure Connector |
| Date Deposited: | 26 Oct 2026 11:02 |
| Last Modified: | 26 Oct 2026 11:02 |
| URI: | https://ueaeprints.uea.ac.uk/id/eprint/104846 |
| DOI: | 10.1007/978-3-319-25226-1_34 |
Actions (login required)
![]() |
View Item |
Tools
Tools