This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by VANLEEUWEN, D. M. Articles by MANDABACH, K. H. Search for Related Content Social Bookmarking                         What's this?

A Note on the Reliability of Ranked Items

New Mexico State University

KEITH H. MANDABACH

New Mexico State University

Instruments may be designed to use either Likert-type items (ratings) or ranks to obtain priority rankings of items. Models commonly used in generalizability theory (GT) provide a basis for assessing the reliability of item measurements based on ratings. However, these commonly used models do not apply when respondents are required to rank a set of items. Unlike ratings, ranks force subject effects to zero. Furthermore, ranks violate independence assumptions, and the dependence between ranks assigned to different items affects the standard error of item mean differences and, consequently, the reliability of the item comparisons. A GT analysis for ranked items is presented and used to derive standard errors for differences between item means as well as an item measurement reliability coefficient. This analysis uses a linear model that is not typically used in GT analyses but that models those features unique to ranks.

Sociological Methods & Research, Vol. 31, No. 1, 87-105 (2002)
DOI: 10.1177/0049124102031001004


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?