Many Labs 3: Evaluating participant pool quality across the academic semester via replication
Ebersole,Charles R. Atherton,Olivia E. Belanger,Aimee L. Skulborstad,Hayley M. Allen,Jill M. Banks,Jonathan B. Baranski,Erica Bernstein,Michael J. Bonfiglio,Diane B. V. Boucher,Leanne
Ebersole,Charles R.
Atherton,Olivia E.
Belanger,Aimee L.
Skulborstad,Hayley M.
Allen,Jill M.
Banks,Jonathan B.
Baranski,Erica
Bernstein,Michael J.
Bonfiglio,Diane B. V.
Boucher,Leanne
Abstract
The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the academic semester. This crowdsourced project examined time of semester variation in 10 known effects, 10 individual differences, and 3 data quality indicators over the course of the academic semester in 20 participant pools (N = 2696) and with an online sample (N = 737). Weak time of semester effects were observed on data quality indicators, participant sex, and a few individual differences conscientiousness, mood, and stress. However, there was little evidence for time of semester qualifying experimental or correlational effects. The generality of this evidence is unknown because only a subset of the tested effects demonstrated evidence for the original result in the whole sample. Mean characteristics of pool samples change slightly during the semester, but these data suggest that those changes are mostly irrelevant for detecting effects. (C) 2015 Elsevier Inc. All rights reserved.
Description
Date
2016-11
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Social psychology, Cognitive psychology, Replication, Participant pool, Individual differences, Sampling effects, Situational effects, SELF-ESTEEM, SUBJECT POOL, PERSONALITY, COGNITION, NEED, TIME, INTERFERENCE, METAANALYSIS, INFORMATION, METAPHORS
Citation
Ebersole, C R, Atherton, O E, Belanger, A L, Skulborstad, H M, Allen, J M, Banks, J B, Baranski, E, Bernstein, M J, Bonfiglio, D B V, Boucher, L, Brown, E R, Budiman, N I, Cairo, A H, Capaldi, C A, Chartier, C R, Chung, J M H, Cicero, D C, Coleman, J A, Conway, J G, Davis, W E, Devos, T, Fletcher, M M, German, K, Grahe, J E, Hermann, A D, Hicks, J A, Honeycutt, N, Humphrey, B, Janus, M, Johnson, D J, Joy-Gaba, J A, Juzeler, H, Keres, A, Kinney, D, Kirshenbaum, J, Klein, R A, Lucas, R E, Lustgraaf, C J N, Martin, D, Menon, M, Metzger, M, Moloney, J M, Morse, P J, Prislin, R, Razza, T, Re, D E, Rule, N O, Sacco, T F, Sauerberger, K, Shrider, E, Shultz, M, Siemsen, C, Sobocko, K, Sternglanz, R W, Summerville, A, Tskhay, K O, van Allen, Z, Vaughn, L A, Walker, R J, Weinberg, A, Wilson, J P, Wirth, J H, Wortman, J & Nosek, B A 2016, 'Many Labs 3 : Evaluating participant pool quality across the academic semester via replication', Journal of Experimental Social Psychology, vol. 67, pp. 68-82. https://doi.org/10.1016/j.jesp.2015.10.012
License
info:eu-repo/semantics/closedAccess