Loading...
Has AI Surpassed Humans in Creative Idea Generation? A Meta-Analysis
de Rooij,Alwin Biskjaer,Michael Mose
de Rooij,Alwin
Biskjaer,Michael Mose
Abstract
Has AI surpassed humans in creative idea generation? This question has gained traction as generative AI (GenAI) has become widely used to support creativity. To evaluate this, we examined the first wave of experimental studies comparing human and GenAI-prompted creative idea generation by conducting a meta-analysis of 17 studies comprising 115 effect sizes. The results showed a small but non-significant pooled effect favoring GenAI. Initial analyses suggested greater originality in GenAI ideas, but sensitivity analysis showed this was driven by a few studies with very large effects. No significant differences were found between human ideas and those generated by prompting specific GenAI models (GPT-3, GPT-3.5, GPT-4). Funnel plots and asymmetry tests indicated no evidence of publication bias, supporting the findings’ validity. This meta-analysis finds no empirical support suggesting that GenAI has surpassed humans in creative idea generation. We discuss sociotechnical and sociocultural approaches as crucial for shaping human and artificial creativity.
Description
Date
2025-05-26
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Creativity, Idea generation, Generative AI, Artificial intelligence, Diffusion models, Meta-analysis, large language models
Citation
de Rooij, A & Biskjaer, M M 2025, 'Has AI Surpassed Humans in Creative Idea Generation? A Meta-Analysis', Paper presented at 36th Annual Conference of the European Association of Cognitive Ergonomics (EACE), Tallinn, Estonia, 7/10/25 - 10/10/25. https://doi.org/10.31234/osf.io/9u2ke_v1, https://doi.org/10.31234/osf.io/9u2ke_v2, https://doi.org/10.1145/3746175.3746189
License
info:eu-repo/semantics/openAccess