Loading...
Thumbnail Image
Item

Item-score reliability in empirical-data sets and its relationship with other item indices

Zijlmans,E.A.O.
Tijmstra,J.
van der Ark,L.A.
Sijtsma,K.
Abstract
Reliability is usually estimated for a total score, but it can also be estimated for item scores. Item-score reliability can be useful to assess the repeatability of an individual item score in a group. Three methods to estimate item-score reliability are discussed, known as method MS, method λ6, and method CA. The item-score reliability methods are compared with four well-known and widely accepted item indices, which are the item-rest correlation, the item-factor loading, the item scalability, and the item discrimination. Realistic values for item-score reliability in empirical-data sets are monitored to obtain an impression of the values to be expected in other empirical-data sets. The relation between the three item-score reliability methods and the four well-known item indices are investigated. Tentatively, a minimum value for the item-score reliability methods to be used in item analysis is recommended. Keywords Coefficient λ6, correction for attenuation, item discrimination, item-factor loading, item-rest correlation, item scalability, item-score reliability
Description
Date
2018
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
ASSOCIATION, Coefficient lambda(6), IRT, JOB-SATISFACTION, MODEL, MOKKEN SCALE ANALYSIS, PERSONALITY, SINGLE-ITEM, VALIDITY, correction for attenuation, item discrimination, item scalability, item-factor loading, item-rest correlation, item-score reliability
Citation
Zijlmans, E A O, Tijmstra, J, van der Ark, L A & Sijtsma, K 2018, 'Item-score reliability in empirical-data sets and its relationship with other item indices', Educational and Psychological Measurement, vol. 78, no. 6, 998-1020. https://doi.org/10.1177/0013164417728358
License
info:eu-repo/semantics/openAccess
Embedded videos