Neuroadaptive technology enables implicit cursor control based on medial prefrontal cortex activity

Thorsten O. Zander, Laurens R. Krol, Niels P. Birbaumer, Klaus Gramann

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

The effectiveness of today's human-machine interaction is limited by a communication bottleneck as operators are required to translate high-level concepts into a machine-mandated sequence of instructions. In contrast, we demonstrate effective, goal-oriented control of a computer system without any form of explicit communication from the human operator. Instead, the system generated the necessary input itself, based on real-time analysis of brain activity. Specific brain responses were evoked by violating the operators' expectations to varying degrees. The evoked brain activity demonstrated detectable differences reflecting congruency with or deviations from the operators' expectations. Real-time analysis of this activity was used to build a user model of those expectations, thus representing the optimal (expected) state as perceived by the operator. Based on this model, which was continuously updated, the computer automatically adapted itself to the expectations of its operator. Further analyses showed this evoked activity to originate from the medial prefrontal cortex and to exhibit a linear correspondence to the degree of expectation violation. These findings extend our understanding of human predictive coding and provide evidence that the information used to generate the user model is task-specific and reflects goal congruency. This paper demonstrates a form of interaction without any explicit input by the operator, enabling computer systems to become neuroadaptive, that is, to automatically adapt to specific aspects of their operator'smindset. Neuroadaptive technology significantlywidens the communication bottleneck and has the potential to fundamentally change the way we interact with technology.

Original languageEnglish
Pages (from-to)14898-14903
Number of pages6
JournalProceedings of the National Academy of Sciences of the United States of America
Volume113
Issue number52
DOIs
Publication statusPublished - Dec 27 2016

Fingerprint

Brain
Communication
Computer systems

Keywords

  • Electroencephalogram
  • Human-computer interaction
  • Neuroadaptive technology
  • Passive brain-computer interfaces
  • Predictive coding

ASJC Scopus subject areas

  • General

Cite this

Neuroadaptive technology enables implicit cursor control based on medial prefrontal cortex activity. / Zander, Thorsten O.; Krol, Laurens R.; Birbaumer, Niels P.; Gramann, Klaus.

In: Proceedings of the National Academy of Sciences of the United States of America, Vol. 113, No. 52, 27.12.2016, p. 14898-14903.

Research output: Contribution to journalArticle

Zander, Thorsten O. ; Krol, Laurens R. ; Birbaumer, Niels P. ; Gramann, Klaus. / Neuroadaptive technology enables implicit cursor control based on medial prefrontal cortex activity. In: Proceedings of the National Academy of Sciences of the United States of America. 2016 ; Vol. 113, No. 52. pp. 14898-14903.
@article{51f0ca6766d1431c85312c119d1a2659,
title = "Neuroadaptive technology enables implicit cursor control based on medial prefrontal cortex activity",
abstract = "The effectiveness of today's human-machine interaction is limited by a communication bottleneck as operators are required to translate high-level concepts into a machine-mandated sequence of instructions. In contrast, we demonstrate effective, goal-oriented control of a computer system without any form of explicit communication from the human operator. Instead, the system generated the necessary input itself, based on real-time analysis of brain activity. Specific brain responses were evoked by violating the operators' expectations to varying degrees. The evoked brain activity demonstrated detectable differences reflecting congruency with or deviations from the operators' expectations. Real-time analysis of this activity was used to build a user model of those expectations, thus representing the optimal (expected) state as perceived by the operator. Based on this model, which was continuously updated, the computer automatically adapted itself to the expectations of its operator. Further analyses showed this evoked activity to originate from the medial prefrontal cortex and to exhibit a linear correspondence to the degree of expectation violation. These findings extend our understanding of human predictive coding and provide evidence that the information used to generate the user model is task-specific and reflects goal congruency. This paper demonstrates a form of interaction without any explicit input by the operator, enabling computer systems to become neuroadaptive, that is, to automatically adapt to specific aspects of their operator'smindset. Neuroadaptive technology significantlywidens the communication bottleneck and has the potential to fundamentally change the way we interact with technology.",
keywords = "Electroencephalogram, Human-computer interaction, Neuroadaptive technology, Passive brain-computer interfaces, Predictive coding",
author = "Zander, {Thorsten O.} and Krol, {Laurens R.} and Birbaumer, {Niels P.} and Klaus Gramann",
year = "2016",
month = "12",
day = "27",
doi = "10.1073/pnas.1605155114",
language = "English",
volume = "113",
pages = "14898--14903",
journal = "Proceedings of the National Academy of Sciences of the United States of America",
issn = "0027-8424",
number = "52",

}

TY - JOUR

T1 - Neuroadaptive technology enables implicit cursor control based on medial prefrontal cortex activity

AU - Zander, Thorsten O.

AU - Krol, Laurens R.

AU - Birbaumer, Niels P.

AU - Gramann, Klaus

PY - 2016/12/27

Y1 - 2016/12/27

N2 - The effectiveness of today's human-machine interaction is limited by a communication bottleneck as operators are required to translate high-level concepts into a machine-mandated sequence of instructions. In contrast, we demonstrate effective, goal-oriented control of a computer system without any form of explicit communication from the human operator. Instead, the system generated the necessary input itself, based on real-time analysis of brain activity. Specific brain responses were evoked by violating the operators' expectations to varying degrees. The evoked brain activity demonstrated detectable differences reflecting congruency with or deviations from the operators' expectations. Real-time analysis of this activity was used to build a user model of those expectations, thus representing the optimal (expected) state as perceived by the operator. Based on this model, which was continuously updated, the computer automatically adapted itself to the expectations of its operator. Further analyses showed this evoked activity to originate from the medial prefrontal cortex and to exhibit a linear correspondence to the degree of expectation violation. These findings extend our understanding of human predictive coding and provide evidence that the information used to generate the user model is task-specific and reflects goal congruency. This paper demonstrates a form of interaction without any explicit input by the operator, enabling computer systems to become neuroadaptive, that is, to automatically adapt to specific aspects of their operator'smindset. Neuroadaptive technology significantlywidens the communication bottleneck and has the potential to fundamentally change the way we interact with technology.

AB - The effectiveness of today's human-machine interaction is limited by a communication bottleneck as operators are required to translate high-level concepts into a machine-mandated sequence of instructions. In contrast, we demonstrate effective, goal-oriented control of a computer system without any form of explicit communication from the human operator. Instead, the system generated the necessary input itself, based on real-time analysis of brain activity. Specific brain responses were evoked by violating the operators' expectations to varying degrees. The evoked brain activity demonstrated detectable differences reflecting congruency with or deviations from the operators' expectations. Real-time analysis of this activity was used to build a user model of those expectations, thus representing the optimal (expected) state as perceived by the operator. Based on this model, which was continuously updated, the computer automatically adapted itself to the expectations of its operator. Further analyses showed this evoked activity to originate from the medial prefrontal cortex and to exhibit a linear correspondence to the degree of expectation violation. These findings extend our understanding of human predictive coding and provide evidence that the information used to generate the user model is task-specific and reflects goal congruency. This paper demonstrates a form of interaction without any explicit input by the operator, enabling computer systems to become neuroadaptive, that is, to automatically adapt to specific aspects of their operator'smindset. Neuroadaptive technology significantlywidens the communication bottleneck and has the potential to fundamentally change the way we interact with technology.

KW - Electroencephalogram

KW - Human-computer interaction

KW - Neuroadaptive technology

KW - Passive brain-computer interfaces

KW - Predictive coding

UR - http://www.scopus.com/inward/record.url?scp=85007482553&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85007482553&partnerID=8YFLogxK

U2 - 10.1073/pnas.1605155114

DO - 10.1073/pnas.1605155114

M3 - Article

VL - 113

SP - 14898

EP - 14903

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

SN - 0027-8424

IS - 52

ER -