The evidence framework applied to sparse kernel logistic regression

Cawley, Gavin C. ORCID: https://orcid.org/0000-0002-4118-9095 and Talbot, Nicola L. C. (2005) The evidence framework applied to sparse kernel logistic regression. Neurocomputing, 64. pp. 119-135. ISSN 0925-2312

Full text not available from this repository. (Request a copy)

Abstract

In this paper we present a simple hierarchical Bayesian treatment of the sparse kernel logistic regression (KLR) model based on the evidence framework introduced by MacKay. The principal innovation lies in the re-parameterisation of the model such that the usual spherical Gaussian prior over the parameters in the kernel-induced feature space also corresponds to a spherical Gaussian prior over the transformed parameters, permitting the straight-forward derivation of an efficient update formula for the regularisation parameter. The Bayesian framework also allows the selection of good values for kernel parameters through maximisation of the marginal likelihood, or evidence, for the model. Results obtained on a variety of benchmark data sets are provided indicating that the Bayesian KLR model is competitive with KLR models, where the hyper-parameters are selected via cross-validation and with the support vector machine and relevance vector machine.

Item Type: Article
Faculty \ School: Faculty of Science > School of Computing Sciences

UEA Research Groups: Faculty of Science > Research Groups > Data Science and Statistics
Faculty of Science > Research Groups > Computational Biology
Faculty of Science > Research Groups > Centre for Ocean and Atmospheric Sciences
Depositing User: Vishal Gautam
Date Deposited: 18 May 2011 11:31
Last Modified: 22 Apr 2023 01:36
URI: https://ueaeprints.uea.ac.uk/id/eprint/21600
DOI: 10.1016/j.neucom.2004.11.021

Actions (login required)

View Item View Item