Temporal auditory capture does not affect the time course of saccadic mislocalization of visual stimuli

Paola Binda, M. Concetta Morrone, David C. Burr

Research output: Contribution to journalArticle

Abstract

Irrelevant sounds can "capture" visual stimuli to change their apparent timing, a phenomenon sometimes termed "temporal ventriloquism". Here we ask whether this auditory capture can alter the time course of spatial mislocalization of visual stimuli during saccades. We first show that during saccades, sounds affect the apparent timing of visual flashes, even more strongly than during fixation. However, this capture does not affect the dynamics of perisaccadic visual distortions. Sounds presented 50 ms before or after a visual bar (that change perceived timing of the bars by more than 40 ms) had no measurable effect on the time courses of spatial mislocalization of the bars, in four subjects. Control studies showed that with barely visible, low-contrast stimuli, leading, but not trailing, sounds can have a small effect on mislocalization, most likely attributable to attentional effects rather than auditory capture. These findings support previous studies showing that integration of multisensory information occurs at a relatively late stage of sensory processing, after visual representations have undergone the distortions induced by saccades.

Original languageEnglish
Pages (from-to)1-13
Number of pages13
JournalJournal of Vision
Volume10
Issue number2
DOIs
Publication statusPublished - 2010

Fingerprint

Saccades

Keywords

  • Eye movements
  • Multisensory
  • Saccadic mislocalization
  • Space-time
  • Spatial vision
  • Temporal vision

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

Temporal auditory capture does not affect the time course of saccadic mislocalization of visual stimuli. / Binda, Paola; Morrone, M. Concetta; Burr, David C.

In: Journal of Vision, Vol. 10, No. 2, 2010, p. 1-13.

Research output: Contribution to journalArticle

@article{bf5c6eff83e34c4d8d71effd8b0d8500,
title = "Temporal auditory capture does not affect the time course of saccadic mislocalization of visual stimuli",
abstract = "Irrelevant sounds can {"}capture{"} visual stimuli to change their apparent timing, a phenomenon sometimes termed {"}temporal ventriloquism{"}. Here we ask whether this auditory capture can alter the time course of spatial mislocalization of visual stimuli during saccades. We first show that during saccades, sounds affect the apparent timing of visual flashes, even more strongly than during fixation. However, this capture does not affect the dynamics of perisaccadic visual distortions. Sounds presented 50 ms before or after a visual bar (that change perceived timing of the bars by more than 40 ms) had no measurable effect on the time courses of spatial mislocalization of the bars, in four subjects. Control studies showed that with barely visible, low-contrast stimuli, leading, but not trailing, sounds can have a small effect on mislocalization, most likely attributable to attentional effects rather than auditory capture. These findings support previous studies showing that integration of multisensory information occurs at a relatively late stage of sensory processing, after visual representations have undergone the distortions induced by saccades.",
keywords = "Eye movements, Multisensory, Saccadic mislocalization, Space-time, Spatial vision, Temporal vision",
author = "Paola Binda and Morrone, {M. Concetta} and Burr, {David C.}",
year = "2010",
doi = "10.1167/10.2.7",
language = "English",
volume = "10",
pages = "1--13",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "2",

}

TY - JOUR

T1 - Temporal auditory capture does not affect the time course of saccadic mislocalization of visual stimuli

AU - Binda, Paola

AU - Morrone, M. Concetta

AU - Burr, David C.

PY - 2010

Y1 - 2010

N2 - Irrelevant sounds can "capture" visual stimuli to change their apparent timing, a phenomenon sometimes termed "temporal ventriloquism". Here we ask whether this auditory capture can alter the time course of spatial mislocalization of visual stimuli during saccades. We first show that during saccades, sounds affect the apparent timing of visual flashes, even more strongly than during fixation. However, this capture does not affect the dynamics of perisaccadic visual distortions. Sounds presented 50 ms before or after a visual bar (that change perceived timing of the bars by more than 40 ms) had no measurable effect on the time courses of spatial mislocalization of the bars, in four subjects. Control studies showed that with barely visible, low-contrast stimuli, leading, but not trailing, sounds can have a small effect on mislocalization, most likely attributable to attentional effects rather than auditory capture. These findings support previous studies showing that integration of multisensory information occurs at a relatively late stage of sensory processing, after visual representations have undergone the distortions induced by saccades.

AB - Irrelevant sounds can "capture" visual stimuli to change their apparent timing, a phenomenon sometimes termed "temporal ventriloquism". Here we ask whether this auditory capture can alter the time course of spatial mislocalization of visual stimuli during saccades. We first show that during saccades, sounds affect the apparent timing of visual flashes, even more strongly than during fixation. However, this capture does not affect the dynamics of perisaccadic visual distortions. Sounds presented 50 ms before or after a visual bar (that change perceived timing of the bars by more than 40 ms) had no measurable effect on the time courses of spatial mislocalization of the bars, in four subjects. Control studies showed that with barely visible, low-contrast stimuli, leading, but not trailing, sounds can have a small effect on mislocalization, most likely attributable to attentional effects rather than auditory capture. These findings support previous studies showing that integration of multisensory information occurs at a relatively late stage of sensory processing, after visual representations have undergone the distortions induced by saccades.

KW - Eye movements

KW - Multisensory

KW - Saccadic mislocalization

KW - Space-time

KW - Spatial vision

KW - Temporal vision

UR - http://www.scopus.com/inward/record.url?scp=77955505991&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77955505991&partnerID=8YFLogxK

U2 - 10.1167/10.2.7

DO - 10.1167/10.2.7

M3 - Article

C2 - 20462308

AN - SCOPUS:77955505991

VL - 10

SP - 1

EP - 13

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 2

ER -