Loading...
VALID: A checklist-based approach for improving validity in psychological research
Kerschbaumer,Susanne Voracek,Martin Aczel,Balazs Anderson,Samantha F. Booth,Brandon M. Buchanan,Erin M. Carlsson,Rickard Heck,Daniel W. Hiekkaranta,Anu Pauliina Hoekstra,Rink
Kerschbaumer,Susanne
Voracek,Martin
Aczel,Balazs
Anderson,Samantha F.
Booth,Brandon M.
Buchanan,Erin M.
Carlsson,Rickard
Heck,Daniel W.
Hiekkaranta,Anu Pauliina
Hoekstra,Rink
Abstract
In response to the replication and confidence crisis across various empirical disciplines, ensuring the validity of research has gained attention. High validity is crucial for obtaining replicable and robust study outcomes when both exploring new questions and replicating previous findings. In this study, we aimed to address this issue by developing a comprehensive checklist to assist researchers in enhancing and monitoring the validity of their research. After systematically analyzing previous findings on validity, a comprehensive list of potential checklist items was compiled. Over the course of three rounds, more than 30 interdisciplinary and psychological-science experts participated in a Delphi study. Experts rated items on their importance and were given the opportunity to propose novel items as well as improve existing ones. This process resulted in a final set of 91 items, organized according to common stages of a research project. The VALID checklist is accessible online (https://www.validchecklist.com/) and provides researchers with an adaptable, versatile tool to monitor and improve the validity of their research and to suit their specific needs. By focusing on adaptiveness during its development, VALID encompasses 331 unique checklist versions, making it a one-stop solution suitable for a wide range of projects, designs, and requirements.
Description
Additional supporting information can be found at http://journals.sagepub.com/doi/supp10.1177/25152459241306432.
Date
2025-03
Journal Title
Journal ISSN
Volume Title
Publisher
Files
Research Projects
Organizational Units
Journal Issue
Keywords
Delphi study, Method reform, Open data, Open materials, Open practices, Preregistered, Study quality appraisal, Tailored online checklist, Validity
Citation
Kerschbaumer, S, Voracek, M, Aczel, B, Anderson, S F, Booth, B M, Buchanan, E M, Carlsson, R, Heck, D W, Hiekkaranta, A P, Hoekstra, R, Karch, J D, Lafit, G, Lin, Z, Liu, S, Mackinnon, D P, Mcgorray, E L, Moreau, D, Papadatou-Pastou, M, Paterson, H, Perera, R A, Schad, D J, Sewell, D K, Syed, M, Tay, L, Tendeiro, J N, Toland, M D, Vanpaemel, W, van Ravenzwaaij, D, Voncken, L & Tran, U S 2025, 'VALID : A checklist-based approach for improving validity in psychological research', Advances in Methods and Practices in Psychological Science, vol. 8, no. 1, 25152459241306432. https://doi.org/10.1177/25152459241306432
License
info:eu-repo/semantics/openAccess