|
Sign In to gain access to subscriptions and/or personal tools.
|
A Critique of the Bayesian Information Criterion for Model Selection
DAVID L. WEAKLIEM
University of Connecticut
The Bayesian information criterion (BIC) has become a popular criterion for model selection in recent years. The BIC is intended to provide a measure of the weight of evidence favoring one model over another, or Bayes factor. It has, however, some important drawbacks that are not widely recognized. First, Bayes factors depend on prior beliefs about the expected distribution of parameter values, and there is no guarantee that the Bayes factor implied by the BIC will be close to one calculated from a prior distribution that an observer would actually regard as appropriate. Second, to obtain the Bayes factors that follow from the BIC, investigators would have to vary their prior distributions depending on the marginal distributions of the variables and the nature of the hypothesis. Such variations seem unwarranted in principle and tend to make the BIC inclined to favor excessively simple models in practice. These points are illustrated by the analysis of several examples, and alternatives to use of the BIC are discussed.
Sociological Methods & Research, Vol. 27, No. 3,
359-397 (1999)
DOI: 10.1177/0049124199027003002
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
J. Erola
Social Mobility and Education of Finnish Cohorts Born 1936--75: Succeeding While Failing in Equality of Opportunity?
Acta Sociologica,
December 1, 2009;
52(4):
307 - 327.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. Hippisley-Cox and C. Coupland
Predicting risk of osteoporotic fracture in men and women in England and Wales: prospective derivation and validation of QFractureScores
BMJ,
November 19, 2009;
339(nov19_1):
b4229 - b4229.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. Hippisley-Cox, C. Coupland, J. Robson, A. Sheikh, and P. Brindle
Predicting risk of type 2 diabetes in England and Wales: prospective derivation and validation of QDScore
BMJ,
March 17, 2009;
338(mar17_2):
b880 - b880.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. C. Liu and P. L. Smith
Comparing time-accuracy curves: Beyond goodness-of-fit measures
Psychon Bull Rev,
February 1, 2009;
16(1):
190 - 203.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. Hippisley-Cox, C. Coupland, Y. Vinogradova, J. Robson, R. Minhas, A. Sheikh, and P. Brindle
Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2
BMJ,
June 28, 2008;
336(7659):
1475 - 1482.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
B. Kolaczkowski and J. W. Thornton
A Mixed Branch Length Model of Heterotachy Improves Phylogenetic Accuracy
Mol. Biol. Evol.,
June 1, 2008;
25(6):
1054 - 1066.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
D. L. Weakliem
Introduction to the Special Issue on Model Selection
Sociological Methods Research,
November 1, 2004;
33(2):
167 - 187.
[PDF]
|
|
|
|
|
|
|
J. Kuha
AIC and BIC: Comparisons of Assumptions and Performance
Sociological Methods Research,
November 1, 2004;
33(2):
188 - 229.
[Abstract]
[PDF]
|
|
|
|
|
|
|
K. P. Burnham and D. R. Anderson
Multimodel Inference: Understanding AIC and BIC in Model Selection
Sociological Methods Research,
November 1, 2004;
33(2):
261 - 304.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. Posada and T. R. Buckley
Model Selection and Model Averaging in Phylogenetics: Advantages of Akaike Information Criterion and Bayesian Approaches Over Likelihood Ratio Tests
Syst Biol,
October 1, 2004;
53(5):
793 - 808.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
F. BASSI, J. A. HAGENAARS, M. A. CROON, and J. K. VERMUNT
Estimating True Changes when Categorical Panel Data are Affected by Uncorrelated and Correlated Classification Errors: An Application to Unemployment Data
Sociological Methods Research,
November 1, 2000;
29(2):
230 - 268.
[Abstract]
[PDF]
|
|
|
|
|
|
|
B. WESTERN
Bayesian Analysis for Sociologists: An Introduction
Sociological Methods Research,
August 1, 1999;
28(1):
7 - 34.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. FIRTH and J. KUHA
Comments on "A Critique of the Bayesian Information Criterion for Model Selection"
Sociological Methods Research,
February 1, 1999;
27(3):
398 - 402.
[PDF]
|
|
|
|
|
|
|
A. GELMAN and D. B. RUBIN
Evaluating and Using Statistical Methods in the Social Sciences: A Discussion of "A Critique of the Bayesian Information Criterion for Model Selection"
Sociological Methods Research,
February 1, 1999;
27(3):
403 - 410.
[PDF]
|
|
|
|
|
|
|
A. E. RAFTERY
Bayes Factors and BIC: Comment on "A Critique of the Bayesian Information Criterion for Model Selection"
Sociological Methods Research,
February 1, 1999;
27(3):
411 - 427.
[PDF]
|
|
|
|
|
|
|
Y. XIE
The Tension between Generality and Accuracy
Sociological Methods Research,
February 1, 1999;
27(3):
428 - 435.
[PDF]
|
|
|
|
|
