Continuity, Co-reference, and Inference in Visual Sequencing
Klomberg,Bien Hacımusaoğlu,Irmak Lichtenberg,Lenneke Schilperoord,Joost Cohn,Neil
Klomberg,Bien
Hacımusaoğlu,Irmak
Lichtenberg,Lenneke
Schilperoord,Joost
Cohn,Neil
Abstract
To understand narratives, comprehenders need to establish to what extent various expressions refer to the same entity, known as co-reference. Research in linguistics has long recognized this fundamental aspect of meaning-making, and perhaps as such, an increasing amount of works have attempted to extend this knowledge to other narrative expressions, such as visual storytelling. However, these applications of semantic and discourse models to visual narratives do not sufficiently account for how different visual signals may be reconciled into a common entity. This core question remains unanswered even in theories characterizing meaning relations for visual sequences in comics specifically. Therefore, this paper proposes a formal theory of visual co-reference that accounts for these issues. We present a model of constraints that describes visual co-reference based on varying correspondences between form (graphic input) and meaning (conceptual structure), including subsequent inferences about temporal and spatial relations across panels and more complex structures of visual discontinuity. This theory is in line with both corpus and psychological findings of visual narratives, and thus presents a robust framework for analyses of visual co-reference.
Description
Date
2023-09-27
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
co-reference, visual narratives, visual language, formal theory, conceptual semantics
Citation
Klomberg, B, Hacımusaoğlu, I, Lichtenberg, L, Schilperoord, J & Cohn, N 2023, 'Continuity, Co-reference, and Inference in Visual Sequencing', Glossa: a journal of general linguistics, vol. 8, no. 1, pp. 1-43. https://doi.org/10.16995/glossa.9982
License
info:eu-repo/semantics/openAccess