Thumbnail Image
Item

Conducting meta-analyses based on p values: Reservations and recommendations for applying p-uniform and p-curve

Van Aert,R.C.M.
; 
Wicherts,J.M.
; 
Van Assen,M.A.L.M.
Abstract
Because of overwhelming evidence of publication bias in psychology, techniques to correct meta-analytic estimates for such bias are greatly needed. The methodology on which the p-uniform and p-curve methods are based has great promise for providing accurate meta-analytic estimates in the presence of publication bias. However, in this article, we show that in some situations, p-curve behaves erratically, whereas p-uniform may yield implausible estimates of negative effect size. Moreover, we show that (and explain why) p-curve and p-uniform result in overestimation of effect size under moderate-to-large heterogeneity and may yield unpredictable bias when researchers employ p-hacking. We offer hands-on recommendations on applying and interpreting results of meta-analyses in general and p-uniform and p-curve in particular. Both methods as well as traditional methods are applied to a meta-analysis on the effect of weight on judgments of importance. We offer guidance for applying p-uniform or p-curve using R and a user-friendly web application for applying p-uniform.
Description
Date
2016-09-01
Journal Title
Journal ISSN
Volume Title
Publisher
Collections
Tilburg University Research Output Collection
Show all metadata
Files
Thumbnail Image
vanAert_Wicherts_vanAssen16.pdf
Adobe PDF, 996.29 KB
Research Projects
Organizational Units
Journal Issue
Keywords
Citation
Van Aert, R C M, Wicherts, J M & Van Assen, M A L M 2016, 'Conducting meta-analyses based on p values : Reservations and recommendations for applying p-uniform and p-curve', Perspectives on Psychological Science, vol. 11, no. 5, pp. 713-729. https://doi.org/10.1177/1745691616650874
URI
https://hdl.handle.net/20.500.14602/65971
Embedded videos