Loading...
Accounting for measurement invariance violations in careless responding detection in intensive longitudinal data: Exploratory vs. partially constrained latent Markov factor analysis
Vogelsmeier,Leonie V. D. E. Jongerling,Joran Ulitzsch,Esther
Vogelsmeier,Leonie V. D. E.
Jongerling,Joran
Ulitzsch,Esther
Abstract
Intensive longitudinal data (ILD) collection methods like experience sampling methodology can place significant burdens on participants, potentially resulting in careless responding, such as random responding. Such behavior can undermine the validity of any inferences drawn from the data if not properly identified and addressed. Recently, a confirmatory mixture model (here referred to as fully constrained latent Markov factor analysis, LMFA) has been introduced as a promising solution to detect careless responding in ILD. However, this method relies on the key assumption of measurement invariance of the attentive responses, which is easily violated due to shifts in how participants interpret items. If the assumption is violated, the ability of the fully constrained LMFA to accurately identify careless responding is compromised. In this study, we evaluated two more flexible variants of LMFA—fully exploratory LMFA and partially constrained LMFA—to distinguish between careless and attentive responding in the presence of non-invariant attentive responses. Simulation results indicated that the fully exploratory LMFA model is an effective tool for reliably detecting and interpreting different types of careless responding while accounting for violations of measurement invariance. Conversely, the partially constrained model struggled to accurately detect careless responses. We end by discussing potential reasons for this.
Description
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Careless responding, ecological momentary assessment, mixture modeling, latent Markov modeling, three-step approach, time series, intensive longitudinal data
Citation
Vogelsmeier, L V D E, Jongerling, J & Ulitzsch, E 2025, 'Accounting for measurement invariance violations in careless responding detection in intensive longitudinal data : Exploratory vs. partially constrained latent Markov factor analysis', Multivariate Behavioral Research, vol. 60, no. 5, pp. 878-897. https://doi.org/10.1080/00273171.2025.2492016
License
info:eu-repo/semantics/openAccess