A Mechanism for detecting coincidence of auditory and visual spatial signals

Emily Orchard-Mills, Johahn Leung, David Burr, Maria Concetta Morrone, Ella Wufong, Simon Carlile, David Alais

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Information about the world is captured by our separate senses, and must be integrated to yield a unified representation. This raises the issue of which signals should be integrated and which should remain separate, as inappropriate integration will lead to misrepresentation and distortions. One strong cue suggesting that separate signals arise from a single source is coincidence, in space and in time. We measured increment thresholds for discriminating spatial intervals defined by pairs of simultaneously presented targets, one flash and one auditory sound, for various separations.We report a 'dipper function', in which thresholds follow a 'U-shaped' curve, with thresholds initially decreasing with spatial interval, and then increasing for larger separations. The presence of a dip in the audiovisual increment-discrimination function is evidence that the auditory and visual signals both input to a common mechanism encoding spatial separation, and a simple filter model with a sigmoidal transduction function simulated the results well. The function of an audiovisual spatial filter may be to detect coincidence, a fundamental cue guiding whether to integrate or segregate.

Original languageEnglish
Pages (from-to)333-345
Number of pages13
JournalMultisensory research
Volume26
Issue number4
DOIs
Publication statusPublished - 2013

Fingerprint

Cues
Acoustic waves
Discrimination (Psychology)

Keywords

  • Audiovisual
  • Dipper function
  • Pedestal
  • Spatial representation
  • Vrossmodal

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Ophthalmology
  • Cognitive Neuroscience
  • Sensory Systems
  • Experimental and Cognitive Psychology
  • Medicine(all)

Cite this

Orchard-Mills, E., Leung, J., Burr, D., Morrone, M. C., Wufong, E., Carlile, S., & Alais, D. (2013). A Mechanism for detecting coincidence of auditory and visual spatial signals. Multisensory research, 26(4), 333-345. https://doi.org/10.1163/22134808-00002425

A Mechanism for detecting coincidence of auditory and visual spatial signals. / Orchard-Mills, Emily; Leung, Johahn; Burr, David; Morrone, Maria Concetta; Wufong, Ella; Carlile, Simon; Alais, David.

In: Multisensory research, Vol. 26, No. 4, 2013, p. 333-345.

Research output: Contribution to journalArticle

Orchard-Mills, E, Leung, J, Burr, D, Morrone, MC, Wufong, E, Carlile, S & Alais, D 2013, 'A Mechanism for detecting coincidence of auditory and visual spatial signals', Multisensory research, vol. 26, no. 4, pp. 333-345. https://doi.org/10.1163/22134808-00002425
Orchard-Mills, Emily ; Leung, Johahn ; Burr, David ; Morrone, Maria Concetta ; Wufong, Ella ; Carlile, Simon ; Alais, David. / A Mechanism for detecting coincidence of auditory and visual spatial signals. In: Multisensory research. 2013 ; Vol. 26, No. 4. pp. 333-345.
@article{0666d959f44f4251a6e6d0f0b0982eb5,
title = "A Mechanism for detecting coincidence of auditory and visual spatial signals",
abstract = "Information about the world is captured by our separate senses, and must be integrated to yield a unified representation. This raises the issue of which signals should be integrated and which should remain separate, as inappropriate integration will lead to misrepresentation and distortions. One strong cue suggesting that separate signals arise from a single source is coincidence, in space and in time. We measured increment thresholds for discriminating spatial intervals defined by pairs of simultaneously presented targets, one flash and one auditory sound, for various separations.We report a 'dipper function', in which thresholds follow a 'U-shaped' curve, with thresholds initially decreasing with spatial interval, and then increasing for larger separations. The presence of a dip in the audiovisual increment-discrimination function is evidence that the auditory and visual signals both input to a common mechanism encoding spatial separation, and a simple filter model with a sigmoidal transduction function simulated the results well. The function of an audiovisual spatial filter may be to detect coincidence, a fundamental cue guiding whether to integrate or segregate.",
keywords = "Audiovisual, Dipper function, Pedestal, Spatial representation, Vrossmodal",
author = "Emily Orchard-Mills and Johahn Leung and David Burr and Morrone, {Maria Concetta} and Ella Wufong and Simon Carlile and David Alais",
year = "2013",
doi = "10.1163/22134808-00002425",
language = "English",
volume = "26",
pages = "333--345",
journal = "Multisensory research",
issn = "2213-4794",
publisher = "Brill",
number = "4",

}

TY - JOUR

T1 - A Mechanism for detecting coincidence of auditory and visual spatial signals

AU - Orchard-Mills, Emily

AU - Leung, Johahn

AU - Burr, David

AU - Morrone, Maria Concetta

AU - Wufong, Ella

AU - Carlile, Simon

AU - Alais, David

PY - 2013

Y1 - 2013

N2 - Information about the world is captured by our separate senses, and must be integrated to yield a unified representation. This raises the issue of which signals should be integrated and which should remain separate, as inappropriate integration will lead to misrepresentation and distortions. One strong cue suggesting that separate signals arise from a single source is coincidence, in space and in time. We measured increment thresholds for discriminating spatial intervals defined by pairs of simultaneously presented targets, one flash and one auditory sound, for various separations.We report a 'dipper function', in which thresholds follow a 'U-shaped' curve, with thresholds initially decreasing with spatial interval, and then increasing for larger separations. The presence of a dip in the audiovisual increment-discrimination function is evidence that the auditory and visual signals both input to a common mechanism encoding spatial separation, and a simple filter model with a sigmoidal transduction function simulated the results well. The function of an audiovisual spatial filter may be to detect coincidence, a fundamental cue guiding whether to integrate or segregate.

AB - Information about the world is captured by our separate senses, and must be integrated to yield a unified representation. This raises the issue of which signals should be integrated and which should remain separate, as inappropriate integration will lead to misrepresentation and distortions. One strong cue suggesting that separate signals arise from a single source is coincidence, in space and in time. We measured increment thresholds for discriminating spatial intervals defined by pairs of simultaneously presented targets, one flash and one auditory sound, for various separations.We report a 'dipper function', in which thresholds follow a 'U-shaped' curve, with thresholds initially decreasing with spatial interval, and then increasing for larger separations. The presence of a dip in the audiovisual increment-discrimination function is evidence that the auditory and visual signals both input to a common mechanism encoding spatial separation, and a simple filter model with a sigmoidal transduction function simulated the results well. The function of an audiovisual spatial filter may be to detect coincidence, a fundamental cue guiding whether to integrate or segregate.

KW - Audiovisual

KW - Dipper function

KW - Pedestal

KW - Spatial representation

KW - Vrossmodal

UR - http://www.scopus.com/inward/record.url?scp=84893209613&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893209613&partnerID=8YFLogxK

U2 - 10.1163/22134808-00002425

DO - 10.1163/22134808-00002425

M3 - Article

VL - 26

SP - 333

EP - 345

JO - Multisensory research

JF - Multisensory research

SN - 2213-4794

IS - 4

ER -