Gesture - Volume 17, Issue 2, 2018

Using recurrent gestures as the model, this essay considers how an inside-looking-out view of speech-gesture production reflects the interactive-social exterior. The inside view may appear to ignore the social context of speaking and gesture, but this is far from the truth. What an exterior view sees as important appears in the interior but in a different way. The difference leads to misunderstandings of the interior view and what it does. It is not a substitute for the exterior. It is the interior reflecting the social exterior and shaping it to fit its own demands. Topics are: recurrent gestures; gesture-speech co-expressivity; expunged real-world goals; “in-betweenness”; phenomenological “inhabitance” and material carriers; metaphoricity and imagery; social deixis and social relations; realizations of the self; world-views; and lastly the want of mutual outside and inside intellectual perceptions and what can be done about it.

Infants can extend their index fingers soon after birth, yet pointing gestures do not emerge until about 10 to 12 months. In the present study, we draw on the process-relational view, according to which pointing develops as infants learn how others respond to their initially non-communicative index finger use. We report on a longitudinal maternal diary study of 15 infants and describe four types of index finger use in the first year. Analysis of the observations suggests one possible developmental pathway: index finger extension becomes linked to infants’ attention around 7 to 9 months of age with the emergence of fingertip exploration and index finger extension towards out-of-reach objects infants wish to explore. Through parental responses infants begin to use index finger touch to refer in some situations, including asking and answering questions and to request, suggesting that some functions of pointing might originate in early index finger use.

We examined the cognitive resources involved in processing speech with gesture compared to the same speech without gesture across four studies using a dual-task paradigm. Participants viewed videos of a woman describing spatial arrays either with gesture or without. They then attempted to choose the target array from among four choices. Participants’ cognitive load was measured as they completed this comprehension task by measuring how well they could remember the location and identity of digits in a secondary task. We found that addressees experience additional visuospatial load when processing gestures compared to speech alone, and that the load primarily comes when addressees attempt to use their memory of the descriptions with gesture to choose the target array. However, this cost only occurs when gestures about horizontal spatial relations (i.e., left and right) are produced from the speaker’s egocentric perspective.

This paper examines the Open Hand Prone ‘vertical palm’ as a resource for participants in conversation for displaying their treatment of a co-participant’s – or their own – turn/action as interruptive. Through this practice participants can manage turn-taking by making it relevant for the co-participant to stop talking. The data for this study consist of video-recorded conversations in English and Finnish from domestic and institutional settings, as well as broadcast talk. Using multimodal conversation analysis, this study shows that the gesture occurs in situations involving overlapping/competitive talk or incompatible embodied activities that somehow affect the progressivity of the ongoing talk. This paper complements previous research on gesture studies and interaction by investigating the function these gestures take in stopping/interrupting a co-participant’s turn-at-talk across multiple settings, and by studying how the gesture functions as a part of a practice which has direct social consequences on the local organization of turn-taking.