A perceptual and behavioral analysis of facial cues to deception in interactions between children and a virtual agent
Vieira Da Fonseca Serras Pereira,M. de Lange,Jolanda Shahid,Suleman Swerts,Marc
Vieira Da Fonseca Serras Pereira,M.
de Lange,Jolanda
Shahid,Suleman
Swerts,Marc
Abstract
This study focused on the facial expressions that children exhibit while trying to deceive a virtual agent. An interactive lie elicitation game was developed to record children’s facial expressions during deceptive and truthful utterances. Our participants did this task either alone or in the presence of peers. A manual method and an automatic recognition approach were used to examine facial expressions and facial action units (AUs). Results show that the facial expressions of deceivers differ from those of truth-tellers: most clearly, they try to cover their lie as they smile significantly more often than truthful children. Moreover, co-presence enhances children’s facial expressive behavior and the number of deceptive cues. To understand whether such features serve as cues for deception detection, using data from children playing alone or together with another child, a perception test was carried out to examine observers’ ability to distinguish young deceivers from truth-tellers. Results show that observers found it easier to discriminate between deceivers and truth-tellers who had played the game in the co-present condition. Our research thus shows that virtual agents can be used as tools to elicit lies in a playful manner, which would be relevant for developmental, educational and behavioral analyses of deceit in growing children.
Description
Date
2018-03
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Child–virtual agent interaction, Lying behavior, Nonverbal communication, Facial expressions, Children
Citation
Vieira Da Fonseca Serras Pereira, M, de Lange, J, Shahid, S & Swerts, M 2018, 'A perceptual and behavioral analysis of facial cues to deception in interactions between children and a virtual agent', International Journal of Child-Computer Interaction, vol. 15, pp. 1-12. https://doi.org/10.1016/j.ijcci.2017.10.003