Kendrick, Kobin H orcid.org/0000-0002-6656-1439, Holler, Judith and Levinson, Stephen C. (2023) Turn-taking in human face-to-face interaction is multimodal:gaze direction and manual gestures aid the coordination of turn transitions. Philosophical Transactions of the Royal Society B: Biological Sciences. ISSN 1471-2970
Abstract
Human communicative interaction is characterized by rapid and precise turn-taking. This is achieved by an intricate system that has been elucidated in the field of conversation analysis, based largely on the study of the audi- tory signal. This model suggests that transitions occur at points of possible completion identified in terms of linguistic units. Despite this, considerable evidence exists that visible bodily actions including gaze and gestures also play a role. To reconcile disparate models and observations in the literature, we combine qualitative and quantitative methods to analyse turn-taking in a corpus of multimodal interaction using eye-trackers and multiple cameras. We show that transitions seem to be inhibited when a speaker averts their gaze at a point of possible turn completion, or when a speaker produces gestures which are beginning or unfinished at such points. We further show that while the direction of a speaker’s gaze does not affect the speed of transitions, the production of manual gestures does: turns with gestures have faster transitions. Our findings suggest that the coordination of transitions involves not only linguistic resources but also visual gestural ones and that the transition-relevance places in turns are multimodal in nature. This article is part of a discussion meeting issue ‘Face2face: advancing the science of social interaction’.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Arts and Humanities (York) > Language and Linguistic Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 01 Mar 2023 13:10 |
Last Modified: | 13 Mar 2025 05:29 |
Published Version: | https://doi.org/10.1098/rstb.2021.0473 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1098/rstb.2021.0473 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:196928 |
Download
Filename: Kendrick_et_al._2023_preprint.pdf
Description: Kendrick et al. (2023) - preprint
Licence: CC-BY 2.5