A neural network approach to fMRI binocular visual rivalry task analysis

Nicola Bertolino, Stefania Ferraro, Anna Nigri, Maria Grazia Bruzzone, Francesco Ghielmetti

Research output: Contribution to journalArticle

Abstract

The purpose of this study was to investigate whether artificial neural networks (ANN) are able to decode participants' conscious experience perception from brain activity alone, using complex and ecological stimuli. To reach the aim we conducted pattern recognition data analysis on fMRI data acquired during the execution of a binocular visual rivalry paradigm (BR). Twelve healthy participants were submitted to fMRI during the execution of a binocular non-rivalry (BNR) and a BR paradigm in which two classes of stimuli (faces and houses) were presented. During the binocular rivalry paradigm, behavioral responses related to the switching between consciously perceived stimuli were also collected. First, we used the BNR paradigm as a functional localizer to identify the brain areas involved the processing of the stimuli. Second, we trained the ANN on the BNR fMRI data restricted to these regions of interest. Third, we applied the trained ANN to the BR data as a 'brain reading' tool to discriminate the pattern of neural activity between the two stimuli. Fourth, we verified the consistency of the ANN outputs with the collected behavioral indicators of which stimulus was consciously perceived by the participants. Our main results showed that the trained ANN was able to generalize across the two different tasks (i.e. BNR and BR) and to identify with high accuracy the cognitive state of the participants (i.e. which stimulus was consciously perceived) during the BR condition. The behavioral response, employed as control parameter, was compared with the network output and a statistically significant percentage of correspondences (p-value

Original languageEnglish
Article numbere105206
JournalPLoS One
Volume9
Issue number8
DOIs
Publication statusPublished - Aug 14 2014

ASJC Scopus subject areas

  • Agricultural and Biological Sciences(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Medicine(all)

Fingerprint Dive into the research topics of 'A neural network approach to fMRI binocular visual rivalry task analysis'. Together they form a unique fingerprint.

  • Cite this