Linguistic typology of motion events in visual narratives
Hacımusaoğlu,Irmak Cohn,Neil
Hacımusaoğlu,Irmak
Cohn,Neil
Abstract
Languages use different strategies to encode motion. Some use particles or "satellites"to describe a path of motion (Satellite-framed or S-languages like English), while others typically use the main verb to convey the path information (Verb-framed or V-languages like French). We here ask: might this linguistic variation lead to differences in the way paths are depicted in visual narratives like comics? We analyzed a corpus of 85 comics originally created by speakers of S-languages (comics from the United States, China, Germany) and V-languages (France, Japan, Korea) for both their depictions of path segments (source, route, and goal) and the visual cues signaling these paths and manner information (e.g., motion lines and postures). Panels from S-languages depicted more path segments overall, especially routes, than those from V-languages, but panels from V-languages more often isolated path segments into their own panels. Additionally, comics from S-languages depicted more motion cues than those from V-languages, and this linguistic typology also interacted with panel framing. Despite these differences across typological groups, analysis of individual countries' comics showed more nuanced variation than a simple S-V dichotomy. These findings suggest a possible influence of spoken language structure on depicting motion events in visual narratives and their sequencing.
Description
Funding Information: Research funding: This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 850975). Publisher Copyright: © 2022 the author(s), published by De Gruyter, Berlin/Boston.
Date
2022-11-01
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
visual language, linguistic typology, motion events, comics, corpus linguistics
Citation
Hacımusaoğlu, I & Cohn, N 2022, 'Linguistic typology of motion events in visual narratives', Cognitive Semiotics, vol. 15, no. 2, pp. 197-222. https://doi.org/10.1515/cogsem-2022-2013
License
info:eu-repo/semantics/openAccess