Bayesian neural networks for classification: How useful is the evidence framework?

Penny, W D. ORCID: https://orcid.org/0000-0001-9064-1191 and Roberts, S J. (1999) Bayesian neural networks for classification: How useful is the evidence framework? Neural Networks, 12 (6). pp. 877-892. ISSN 0893-6080

Full text not available from this repository. (Request a copy)

Abstract

This paper presents an empirical assessment of the Bayesian evidence framework for neural networks using four synthetic and four real-world classification problems. We focus on three issues; model selection, automatic relevance determination (ARD) and the use of committees. Model selection using the evidence criterion is only tenable if the number of training examples exceeds the number of network weights by a factor of five or ten. With this number of available examples, however, cross-validation is a viable alternative. The ARD feature selection scheme is only useful in networks with many hidden units and for data sets containing many irrelevant variables. ARD is also useful as a hard feature selection method. Results on applying the evidence framework to the real-world data sets showed that committees of Bayesian networks achieved classification accuracies similar to the best alternative methods. Importantly, this was achievable with a minimum of human intervention.

Item Type:	Article
Faculty \ School:	Faculty of Social Sciences > School of Psychology
UEA Research Groups:	Faculty of Social Sciences > Research Centres > Centre for Behavioural and Experimental Social Sciences
Depositing User:	Pure Connector
Date Deposited:	23 Aug 2017 05:04
Last Modified:	19 Apr 2023 22:33
URI:	https://ueaeprints.uea.ac.uk/id/eprint/64637
DOI:	10.1016/S0893-6080(99)00040-4

Actions (login required)

View Item