Self-regulation of the anterior insula: Reinforcement learning using real-time fMRI neurofeedback

Emma J. Lawrence, Li Su, Gareth J. Barker, Nick Medford, Jeffrey Dalton, Steve C R Williams, Niels Birbaumer, Ralf Veit, Sitaram Ranganatha, Jerzy Bodurka, Michael Brammer, Vincent Giampietro, Anthony S. David

Research output: Contribution to journalArticle

Abstract

The anterior insula (AI) plays a key role in affective processing, and insular dysfunction has been noted in several clinical conditions. Real-time functional MRI neurofeedback (rtfMRI-NF) provides a means of helping people learn to self-regulate activation in this brain region. Using the Blood Oxygenated Level Dependant (BOLD) signal from the right AI (RAI) as neurofeedback, we trained participants to increase RAI activation. In contrast, another group of participants was shown 'control' feedback from another brain area. Pre- and post-training affective probes were shown, with subjective ratings and skin conductance response (SCR) measured. We also investigated a reward-related reinforcement learning model of rtfMRI-NF. In contrast to the controls, we hypothesised a positive linear increase in RAI activation in participants shown feedback from this region, alongside increases in valence ratings and SCR to affective probes. Hypothesis-driven analyses showed a significant interaction between the RAI/control neurofeedback groups and the effect of self-regulation. Whole-brain analyses revealed a significant linear increase in RAI activation across four training runs in the group who received feedback from RAI. Increased activation was also observed in the caudate body and thalamus, likely representing feedback-related learning. No positive linear trend was observed in the RAI in the group receiving control feedback, suggesting that these data are not a general effect of cognitive strategy or control feedback. The control group did, however, show diffuse activation across the putamen, caudate and posterior insula which may indicate the representation of false feedback. No significant training-related behavioural differences were observed for valence ratings, or SCR. In addition, correlational analyses based on a reinforcement learning model showed that the dorsal anterior cingulate cortex underpinned learning in both groups. In summary, these data demonstrate that it is possible to regulate the RAI using rtfMRI-NF within one scanning session, and that such reward-related learning is mediated by the dorsal anterior cingulate.

Original languageEnglish
Pages (from-to)113-124
Number of pages12
JournalNeuroImage
Volume88
DOIs
Publication statusPublished - Mar 2014

Fingerprint

Neurofeedback
Magnetic Resonance Imaging
Learning
Gyrus Cinguli
Reward
Control Groups
Skin
Brain
Putamen
Thalamus
Reinforcement (Psychology)
Self-Control

Keywords

  • Emotion
  • Insula
  • Neurofeedback
  • Real-time fMRI
  • Reinforcement learning
  • Self-regulation

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Neurology

Cite this

Lawrence, E. J., Su, L., Barker, G. J., Medford, N., Dalton, J., Williams, S. C. R., ... David, A. S. (2014). Self-regulation of the anterior insula: Reinforcement learning using real-time fMRI neurofeedback. NeuroImage, 88, 113-124. https://doi.org/10.1016/j.neuroimage.2013.10.069

Self-regulation of the anterior insula : Reinforcement learning using real-time fMRI neurofeedback. / Lawrence, Emma J.; Su, Li; Barker, Gareth J.; Medford, Nick; Dalton, Jeffrey; Williams, Steve C R; Birbaumer, Niels; Veit, Ralf; Ranganatha, Sitaram; Bodurka, Jerzy; Brammer, Michael; Giampietro, Vincent; David, Anthony S.

In: NeuroImage, Vol. 88, 03.2014, p. 113-124.

Research output: Contribution to journalArticle

Lawrence, EJ, Su, L, Barker, GJ, Medford, N, Dalton, J, Williams, SCR, Birbaumer, N, Veit, R, Ranganatha, S, Bodurka, J, Brammer, M, Giampietro, V & David, AS 2014, 'Self-regulation of the anterior insula: Reinforcement learning using real-time fMRI neurofeedback', NeuroImage, vol. 88, pp. 113-124. https://doi.org/10.1016/j.neuroimage.2013.10.069
Lawrence, Emma J. ; Su, Li ; Barker, Gareth J. ; Medford, Nick ; Dalton, Jeffrey ; Williams, Steve C R ; Birbaumer, Niels ; Veit, Ralf ; Ranganatha, Sitaram ; Bodurka, Jerzy ; Brammer, Michael ; Giampietro, Vincent ; David, Anthony S. / Self-regulation of the anterior insula : Reinforcement learning using real-time fMRI neurofeedback. In: NeuroImage. 2014 ; Vol. 88. pp. 113-124.
@article{2a319576666a4affbb46f0c8c9f7f522,
title = "Self-regulation of the anterior insula: Reinforcement learning using real-time fMRI neurofeedback",
abstract = "The anterior insula (AI) plays a key role in affective processing, and insular dysfunction has been noted in several clinical conditions. Real-time functional MRI neurofeedback (rtfMRI-NF) provides a means of helping people learn to self-regulate activation in this brain region. Using the Blood Oxygenated Level Dependant (BOLD) signal from the right AI (RAI) as neurofeedback, we trained participants to increase RAI activation. In contrast, another group of participants was shown 'control' feedback from another brain area. Pre- and post-training affective probes were shown, with subjective ratings and skin conductance response (SCR) measured. We also investigated a reward-related reinforcement learning model of rtfMRI-NF. In contrast to the controls, we hypothesised a positive linear increase in RAI activation in participants shown feedback from this region, alongside increases in valence ratings and SCR to affective probes. Hypothesis-driven analyses showed a significant interaction between the RAI/control neurofeedback groups and the effect of self-regulation. Whole-brain analyses revealed a significant linear increase in RAI activation across four training runs in the group who received feedback from RAI. Increased activation was also observed in the caudate body and thalamus, likely representing feedback-related learning. No positive linear trend was observed in the RAI in the group receiving control feedback, suggesting that these data are not a general effect of cognitive strategy or control feedback. The control group did, however, show diffuse activation across the putamen, caudate and posterior insula which may indicate the representation of false feedback. No significant training-related behavioural differences were observed for valence ratings, or SCR. In addition, correlational analyses based on a reinforcement learning model showed that the dorsal anterior cingulate cortex underpinned learning in both groups. In summary, these data demonstrate that it is possible to regulate the RAI using rtfMRI-NF within one scanning session, and that such reward-related learning is mediated by the dorsal anterior cingulate.",
keywords = "Emotion, Insula, Neurofeedback, Real-time fMRI, Reinforcement learning, Self-regulation",
author = "Lawrence, {Emma J.} and Li Su and Barker, {Gareth J.} and Nick Medford and Jeffrey Dalton and Williams, {Steve C R} and Niels Birbaumer and Ralf Veit and Sitaram Ranganatha and Jerzy Bodurka and Michael Brammer and Vincent Giampietro and David, {Anthony S.}",
year = "2014",
month = "3",
doi = "10.1016/j.neuroimage.2013.10.069",
language = "English",
volume = "88",
pages = "113--124",
journal = "NeuroImage",
issn = "1053-8119",
publisher = "Academic Press Inc.",

}

TY - JOUR

T1 - Self-regulation of the anterior insula

T2 - Reinforcement learning using real-time fMRI neurofeedback

AU - Lawrence, Emma J.

AU - Su, Li

AU - Barker, Gareth J.

AU - Medford, Nick

AU - Dalton, Jeffrey

AU - Williams, Steve C R

AU - Birbaumer, Niels

AU - Veit, Ralf

AU - Ranganatha, Sitaram

AU - Bodurka, Jerzy

AU - Brammer, Michael

AU - Giampietro, Vincent

AU - David, Anthony S.

PY - 2014/3

Y1 - 2014/3

N2 - The anterior insula (AI) plays a key role in affective processing, and insular dysfunction has been noted in several clinical conditions. Real-time functional MRI neurofeedback (rtfMRI-NF) provides a means of helping people learn to self-regulate activation in this brain region. Using the Blood Oxygenated Level Dependant (BOLD) signal from the right AI (RAI) as neurofeedback, we trained participants to increase RAI activation. In contrast, another group of participants was shown 'control' feedback from another brain area. Pre- and post-training affective probes were shown, with subjective ratings and skin conductance response (SCR) measured. We also investigated a reward-related reinforcement learning model of rtfMRI-NF. In contrast to the controls, we hypothesised a positive linear increase in RAI activation in participants shown feedback from this region, alongside increases in valence ratings and SCR to affective probes. Hypothesis-driven analyses showed a significant interaction between the RAI/control neurofeedback groups and the effect of self-regulation. Whole-brain analyses revealed a significant linear increase in RAI activation across four training runs in the group who received feedback from RAI. Increased activation was also observed in the caudate body and thalamus, likely representing feedback-related learning. No positive linear trend was observed in the RAI in the group receiving control feedback, suggesting that these data are not a general effect of cognitive strategy or control feedback. The control group did, however, show diffuse activation across the putamen, caudate and posterior insula which may indicate the representation of false feedback. No significant training-related behavioural differences were observed for valence ratings, or SCR. In addition, correlational analyses based on a reinforcement learning model showed that the dorsal anterior cingulate cortex underpinned learning in both groups. In summary, these data demonstrate that it is possible to regulate the RAI using rtfMRI-NF within one scanning session, and that such reward-related learning is mediated by the dorsal anterior cingulate.

AB - The anterior insula (AI) plays a key role in affective processing, and insular dysfunction has been noted in several clinical conditions. Real-time functional MRI neurofeedback (rtfMRI-NF) provides a means of helping people learn to self-regulate activation in this brain region. Using the Blood Oxygenated Level Dependant (BOLD) signal from the right AI (RAI) as neurofeedback, we trained participants to increase RAI activation. In contrast, another group of participants was shown 'control' feedback from another brain area. Pre- and post-training affective probes were shown, with subjective ratings and skin conductance response (SCR) measured. We also investigated a reward-related reinforcement learning model of rtfMRI-NF. In contrast to the controls, we hypothesised a positive linear increase in RAI activation in participants shown feedback from this region, alongside increases in valence ratings and SCR to affective probes. Hypothesis-driven analyses showed a significant interaction between the RAI/control neurofeedback groups and the effect of self-regulation. Whole-brain analyses revealed a significant linear increase in RAI activation across four training runs in the group who received feedback from RAI. Increased activation was also observed in the caudate body and thalamus, likely representing feedback-related learning. No positive linear trend was observed in the RAI in the group receiving control feedback, suggesting that these data are not a general effect of cognitive strategy or control feedback. The control group did, however, show diffuse activation across the putamen, caudate and posterior insula which may indicate the representation of false feedback. No significant training-related behavioural differences were observed for valence ratings, or SCR. In addition, correlational analyses based on a reinforcement learning model showed that the dorsal anterior cingulate cortex underpinned learning in both groups. In summary, these data demonstrate that it is possible to regulate the RAI using rtfMRI-NF within one scanning session, and that such reward-related learning is mediated by the dorsal anterior cingulate.

KW - Emotion

KW - Insula

KW - Neurofeedback

KW - Real-time fMRI

KW - Reinforcement learning

KW - Self-regulation

UR - http://www.scopus.com/inward/record.url?scp=84892899976&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84892899976&partnerID=8YFLogxK

U2 - 10.1016/j.neuroimage.2013.10.069

DO - 10.1016/j.neuroimage.2013.10.069

M3 - Article

AN - SCOPUS:84892899976

VL - 88

SP - 113

EP - 124

JO - NeuroImage

JF - NeuroImage

SN - 1053-8119

ER -