Interaction Between Words and Symbolic Gestures as Revealed By N400

Maddalena Fabbri-Destro, Pietro Avanzini, Elisa De Stefani, Alessandro Innocenti, Cristina Campi, Maurizio Gentilucci

Research output: Contribution to journalArticle

Abstract

What happens if you see a person pronouncing the word “go” after having gestured “stop”? Differently from iconic gestures, that must necessarily be accompanied by verbal language in order to be unambiguously understood, symbolic gestures are so conventionalized that they can be effortlessly understood in the absence of speech. Previous studies proposed that gesture and speech belong to a unique communication system. From an electrophysiological perspective the N400 modulation was considered the main variable indexing the interplay between two stimuli. However, while many studies tested this effect between iconic gestures and speech, little is known about the capability of an emblem to modulate the neural response to subsequently presented words. Using high-density EEG, the present study aimed at evaluating the presence of an N400 effect and its spatiotemporal dynamics, in terms of cortical activations, when emblems primed the observation of words. Participants were presented with symbolic gestures followed by a semantically congruent or incongruent verb. A N400 modulation was detected, showing larger negativity when gesture and words were incongruent. The source localization during N400 time window evidenced the activation of different portions of temporal cortex according to the gesture and word congruence. Our data provide further evidence of how the observation of an emblem influences verbal language perception, and of how this interplay is mainly instanced by different portions of the temporal cortex.

Original languageEnglish
Pages (from-to)591-605
Number of pages15
JournalBrain Topography
Volume28
Issue number4
DOIs
Publication statusPublished - Aug 15 2014

Keywords

  • Anterior temporal pole
  • High density EEG
  • Medial temporal cortex
  • N400 potential
  • Symbolic gestures
  • Words

ASJC Scopus subject areas

  • Clinical Neurology
  • Anatomy
  • Neurology
  • Radiology Nuclear Medicine and imaging
  • Radiological and Ultrasound Technology

Fingerprint Dive into the research topics of 'Interaction Between Words and Symbolic Gestures as Revealed By N400'. Together they form a unique fingerprint.

  • Cite this

    Fabbri-Destro, M., Avanzini, P., De Stefani, E., Innocenti, A., Campi, C., & Gentilucci, M. (2014). Interaction Between Words and Symbolic Gestures as Revealed By N400. Brain Topography, 28(4), 591-605. https://doi.org/10.1007/s10548-014-0392-4