I. Ghahramani. Technical Report, GCNU-TR 2005-003. Gatsby Computational Neuroscience Unit, University College London, UK, (2005)
Abstract
In his thesis, MacKay (1991) introduced figure
1, explaining how Bayes rule provides an automatic “Oc-
cam’s razor” effect, penalizing unnecessarily complex mod-
els. This figure has been adopted by several authors in the same schematic form. Here, after briefly reviewing neces-
sary material, we compute a realization of the plot for a
toy data modeling problem. We discuss interesting aspects
of this plot and their implications for understanding model complexity.
%0 Report
%1 ghahramani_note_2005
%A Ghahramani, Iain Murray Zoubin
%C University College London, UK
%D 2005
%K Bayesian inference, model selection
%N GCNU-TR 2005-003
%P 4
%T A note on the evidence and Bayesian Occam’s razor
%U http://www.gatsby.ucl.ac.uk/
%X In his thesis, MacKay (1991) introduced figure
1, explaining how Bayes rule provides an automatic “Oc-
cam’s razor” effect, penalizing unnecessarily complex mod-
els. This figure has been adopted by several authors in the same schematic form. Here, after briefly reviewing neces-
sary material, we compute a realization of the plot for a
toy data modeling problem. We discuss interesting aspects
of this plot and their implications for understanding model complexity.
@techreport{ghahramani_note_2005,
abstract = {In his thesis, MacKay (1991) introduced figure
1, explaining how Bayes rule provides an automatic “Oc-
cam’s razor” effect, penalizing unnecessarily complex mod-
els. This figure has been adopted by several authors in the same schematic form. Here, after briefly reviewing neces-
sary material, we compute a realization of the plot for a
toy data modeling problem. We discuss interesting aspects
of this plot and their implications for understanding model complexity.},
added-at = {2017-01-09T13:57:26.000+0100},
address = {University College London, UK},
author = {Ghahramani, Iain Murray Zoubin},
biburl = {https://www.bibsonomy.org/bibtex/2aa042ca4ff54becaef5967dd49a955ac/yourwelcome},
institution = {Gatsby Computational Neuroscience Unit},
interhash = {aad0fd31d61018b35b4ab9ddc7736a08},
intrahash = {aa042ca4ff54becaef5967dd49a955ac},
keywords = {Bayesian inference, model selection},
number = {GCNU-TR 2005-003},
pages = 4,
timestamp = {2017-01-09T14:01:11.000+0100},
title = {A note on the evidence and {Bayesian} {Occam}’s razor},
type = {Technical {Report}},
url = {http://www.gatsby.ucl.ac.uk/},
urldate = {2016-03-19},
year = 2005
}