Loading...
Thumbnail Image
Item

On a generalizable approach for sample size determination in Bayesian t tests

Wong,Tsz Keung
Tendeiro,Jorge N.
Abstract
The Bayes factor is often proposed as a superior replacement to p values in testing null hypotheses for various reasons, with the availability of many user-friendly and easily accessible statistical software tools facilitating the use of Bayesian tests. Meanwhile, Bayes factor design analysis (BFDA), the counterpart of power analysis, is also proposed to ensure the maximum efficiency and informativeness of a study. Despite tools for conducting BFDA being limited and mostly relying on Monte Carlo methodology, methods based on root-finding algorithms have been recently developed (e.g., Pawel and Held, 2025), overcoming weaknesses of simulation approaches. This paper builds on these advancements by presenting a method generalizing the existing approach for conducting BFDA for sample size determination in t tests. The major advantage of the current method is that it does not assume normality of the effect size estimate, allowing more flexibility in the specification of the design and analysis priors. We developed and showcase a user-friendly Shiny app for facilitating the use of BFDA, illustrated with an empirical example. Furthermore, using our method, we explore the operating characteristics of the Bayes factors using various priors.
Description
© 2025. The Author(s).
Date
2025-03-31
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Algorithms, Bayes Theorem, Computer Simulation, Data Interpretation, Statistical, Humans, Models, Statistical, Monte Carlo Method, Research Design, Sample Size, Software
Citation
Wong, T K & Tendeiro, J N 2025, 'On a generalizable approach for sample size determination in Bayesian t tests', Behavior Research Methods, vol. 57, no. 5, 130. https://doi.org/10.3758/s13428-025-02654-x
Embedded videos