The evidence framework applied to sparse kernel logistic regression

Cawley, Gavin C. ORCID: and Talbot, Nicola L. C. (2005) The evidence framework applied to sparse kernel logistic regression. Neurocomputing, 64. pp. 119-135. ISSN 0925-2312

Full text not available from this repository. (Request a copy)


In this paper we present a simple hierarchical Bayesian treatment of the sparse kernel logistic regression (KLR) model based on the evidence framework introduced by MacKay. The principal innovation lies in the re-parameterisation of the model such that the usual spherical Gaussian prior over the parameters in the kernel-induced feature space also corresponds to a spherical Gaussian prior over the transformed parameters, permitting the straight-forward derivation of an efficient update formula for the regularisation parameter. The Bayesian framework also allows the selection of good values for kernel parameters through maximisation of the marginal likelihood, or evidence, for the model. Results obtained on a variety of benchmark data sets are provided indicating that the Bayesian KLR model is competitive with KLR models, where the hyper-parameters are selected via cross-validation and with the support vector machine and relevance vector machine.

Item Type: Article
Faculty \ School: Faculty of Science > School of Computing Sciences

University of East Anglia > Faculty of Science > Research Groups > Computational Biology (subgroups are shown below) > Machine learning in computational biology
Depositing User: Vishal Gautam
Date Deposited: 18 May 2011 11:31
Last Modified: 27 Feb 2023 17:31
DOI: 10.1016/j.neucom.2004.11.021

Actions (login required)

View Item View Item