Multi-factorial analysis of class prediction error: Estimating optimal number of biomarkers for various classification rules

Khondoker, Mizanur R. ORCID: https://orcid.org/0000-0002-1801-1635, Bachmann, Till T., Mewissen, Muriel, Dickinson, Paul, Dobrzelecki, Bartosz, Campbell, Colin J., Mount, Andrew R., Walton, Anthony J., Crain, Jason, Schulze, Holger, Giraud, Gerard, Ross, Alan J., Ciani, Ilenia, Ember, Stuart W. J., Tlili, Chaker, Terry, Jonathan G., Grant, Eilidh, McDonnell, Nicola and Ghazal, Peter (2010) Multi-factorial analysis of class prediction error: Estimating optimal number of biomarkers for various classification rules. Journal of Bioinformatics and Computational Biology, 08 (06). ISSN 0219-7200

Full text not available from this repository. (Request a copy)

Abstract

Machine learning and statistical model based classifiers have increasingly been used with more complex and high dimensional biological data obtained from high-throughput technologies. Understanding the impact of various factors associated with large and complex microarray datasets on the predictive performance of classifiers is computationally intensive, under investigated, yet vital in determining the optimal number of biomarkers for various classification purposes aimed towards improved detection, diagnosis, and therapeutic monitoring of diseases. We investigate the impact of microarray based data characteristics on the predictive performance for various classification rules using simulation studies. Our investigation using Random Forest, Support Vector Machines, Linear Discriminant Analysis and k-Nearest Neighbour shows that the predictive performance of classifiers is strongly influenced by training set size, biological and technical variability, replication, fold change and correlation between biomarkers. Optimal number of biomarkers for a classification problem should therefore be estimated taking account of the impact of all these factors. A database of average generalization errors is built for various combinations of these factors. The database of generalization errors can be used for estimating the optimal number of biomarkers for given levels of predictive accuracy as a function of these factors. Examples show that curves from actual biological data resemble that of simulated data with corresponding levels of data characteristics. An R package optBiomarker implementing the method is freely available for academic use from the Comprehensive R Archive Network ().

Item Type: Article
Uncontrolled Keywords: microarrays,gene expression,machine learning,classification,leave-one-out cross-validation
Faculty \ School: Faculty of Medicine and Health Sciences > Norwich Medical School
UEA Research Groups: Faculty of Medicine and Health Sciences > Research Groups > Epidemiology and Public Health
Faculty of Medicine and Health Sciences > Research Groups > Public Health and Health Services Research (former - to 2023)
Faculty of Science > Research Groups > Norwich Epidemiology Centre
Faculty of Medicine and Health Sciences > Research Groups > Norwich Epidemiology Centre
Faculty of Medicine and Health Sciences > Research Centres > Population Health
Depositing User: Pure Connector
Date Deposited: 24 Sep 2016 00:40
Last Modified: 19 Oct 2023 01:46
URI: https://ueaeprints.uea.ac.uk/id/eprint/60174
DOI: 10.1142/S0219720010005063

Actions (login required)

View Item View Item