This Article Full Text (OnlineFirst PDF) Online Appendix Online Appendix All Versions of this Article: 0049124108318973v1 37/1/3    most recent Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Gerber, A. S. Articles by Malhotra, N. Search for Related Content Social Bookmarking                         What's this?

Publication Bias in Empirical Sociological Research: Do Arbitrary Significance Levels Distort Published Results?

¹ Yale University
² Stanford University

^* To whom correspondence should be addressed. E-mail: neilm{at}stanford.edu.

	Abstract

Despite great attention to the quality of research methods in individual studies, if publication decisions of journals are a function of the statistical significance of research findings, the published literature as a whole may not produce accurate measures of true effects. This article examines the two most prominent sociology journals (the American Sociological Review and the American Journal of Sociology) and another important though less influential journal (The Sociological Quarterly) for evidence of publication bias. The effect of the .05 significance level on the pattern of published findings is examined using a "caliper" test, and the hypothesis of no publication bias can be rejected at approximately the 1 in 10 million level. Findings suggest that some of the results reported in leading sociology journals may be misleading and inaccurate due to publication bias. Some reasons for publication bias and proposed reforms to reduce its impact on research are also discussed.

First published on June 10, 2008, doi:10.1177/0049124108318973

Sociological Methods & Research 2008;37:3.

A more recent version of this article appeared on August 1, 2008


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				S. G Moreno, A. J Sutton, E. H Turner, K. R Abrams, N. J Cooper, T. M Palmer, and A E Ades Novel methods to deal with publication biases: secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications BMJ, August 7, 2009; 339(aug07_1): b2981 - b2981. [Abstract] [Full Text] [PDF]