Controlling for response order effects in ranking items using latent choice factor modeling
Vriens,I.P.M. Moors,G.B.D. Gelissen,J.P.T.M. Vermunt,J. K.
Vriens,I.P.M.
Moors,G.B.D.
Gelissen,J.P.T.M.
Vermunt,J. K.
Abstract
Measuring values in sociological research sometimes involves the use of ranking data. A disadvantage of a ranking assignment is that the order in which the items are presented might influence the choice preferences of respondents regardless of the content being measured. The standard procedure to rule out such effects is to randomize the order of items across respondents. However, implementing this design may be impractical and the biasing impact of a response order effect cannot be evaluated. We use a latent choice factor (LCF) model that allows statistically controlling for response order effects. Furthermore, the model adequately deals with the known issue of ipsativity of ranking data. Applying this model to a Dutch survey on work values, we show that a primacy effect accounts for response order bias in item preferences. Our findings demonstrate the usefulness of the LCF model in modeling ranking data while taking into account particular response biases.
Description
Date
2017
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Citation
Vriens, I P M, Moors, G B D, Gelissen, J P T M & Vermunt, J K 2017, 'Controlling for response order effects in ranking items using latent choice factor modeling', Sociological Methods & Research, vol. 46, no. 2, pp. 218-241. https://doi.org/10.1177/0049124115588997