Physiological responses during hybrid BNCI control of an upper-limb exoskeleton

Francisco J. Badesa, Jorge A. Diez, Jose Maria Catalan, Emilio Trigili, Francesca Cordella, Marius Nann, Simona Crea, Surjo R. Soekadar, Loredana Zollo, Nicola Vitiello, Nicolas Garcia-Aracil

Research output: Contribution to journalArticle

Abstract

When combined with assistive robotic devices, such as wearable robotics, brain/neural-computer interfaces (BNCI) have the potential to restore the capabilities of handicapped people to carry out activities of daily living. To improve applicability of such systems, workload and stress should be reduced to a minimal level. Here, we investigated the user’s physiological reactions during the exhaustive use of the interfaces of a hybrid control interface. Eleven BNCI-naive healthy volunteers participated in the experiments. All participants sat in a comfortable chair in front of a desk and wore a whole-arm exoskeleton as well as wearable devices for monitoring physiological, electroencephalographic (EEG) and electrooculographic (EoG) signals. The experimental protocol consisted of three phases: (i) Set-up, calibration and BNCI training; (ii) Familiarization phase; and (iii) Experimental phase during which each subject had to perform EEG and EoG tasks. After completing each task, the NASA-TLX questionnaire and self-assessment manikin (SAM) were completed by the user. We found significant differences (p-value < 0.05) in heart rate variability (HRV) and skin conductance level (SCL) between participants during the use of the two different biosignal modalities (EEG, EoG) of the BNCI. This indicates that EEG control is associated with a higher level of stress (associated with a decrease in HRV) and mental work load (associated with a higher level of SCL) when compared to EoG control. In addition, HRV and SCL modulations correlated with the subject’s workload perception and emotional responses assessed through NASA-TLX questionnaires and SAM.

Original languageEnglish
Article number4931
JournalSensors (Switzerland)
Volume19
Issue number22
DOIs
Publication statusPublished - Nov 2 2019

Fingerprint

exoskeletons
physiological responses
Brain-Computer Interfaces
limbs
Upper Extremity
Interfaces (computer)
brain
Brain
Workload
United States National Aeronautics and Space Administration
Manikins
heart rate
Heart Rate
Robotics
Skin
robotics
Self-Help Devices
NASA
Physiologic Monitoring
Disabled Persons

Keywords

  • Assistive technologies
  • Brain-computer interfaces
  • Exoskeleton

ASJC Scopus subject areas

  • Analytical Chemistry
  • Biochemistry
  • Atomic and Molecular Physics, and Optics
  • Instrumentation
  • Electrical and Electronic Engineering

Cite this

Badesa, F. J., Diez, J. A., Catalan, J. M., Trigili, E., Cordella, F., Nann, M., ... Garcia-Aracil, N. (2019). Physiological responses during hybrid BNCI control of an upper-limb exoskeleton. Sensors (Switzerland), 19(22), [4931]. https://doi.org/10.3390/s19224931

Physiological responses during hybrid BNCI control of an upper-limb exoskeleton. / Badesa, Francisco J.; Diez, Jorge A.; Catalan, Jose Maria; Trigili, Emilio; Cordella, Francesca; Nann, Marius; Crea, Simona; Soekadar, Surjo R.; Zollo, Loredana; Vitiello, Nicola; Garcia-Aracil, Nicolas.

In: Sensors (Switzerland), Vol. 19, No. 22, 4931, 02.11.2019.

Research output: Contribution to journalArticle

Badesa, FJ, Diez, JA, Catalan, JM, Trigili, E, Cordella, F, Nann, M, Crea, S, Soekadar, SR, Zollo, L, Vitiello, N & Garcia-Aracil, N 2019, 'Physiological responses during hybrid BNCI control of an upper-limb exoskeleton', Sensors (Switzerland), vol. 19, no. 22, 4931. https://doi.org/10.3390/s19224931
Badesa FJ, Diez JA, Catalan JM, Trigili E, Cordella F, Nann M et al. Physiological responses during hybrid BNCI control of an upper-limb exoskeleton. Sensors (Switzerland). 2019 Nov 2;19(22). 4931. https://doi.org/10.3390/s19224931
Badesa, Francisco J. ; Diez, Jorge A. ; Catalan, Jose Maria ; Trigili, Emilio ; Cordella, Francesca ; Nann, Marius ; Crea, Simona ; Soekadar, Surjo R. ; Zollo, Loredana ; Vitiello, Nicola ; Garcia-Aracil, Nicolas. / Physiological responses during hybrid BNCI control of an upper-limb exoskeleton. In: Sensors (Switzerland). 2019 ; Vol. 19, No. 22.
@article{afe3aa3a697c4e228b948213fb9b4c49,
title = "Physiological responses during hybrid BNCI control of an upper-limb exoskeleton",
abstract = "When combined with assistive robotic devices, such as wearable robotics, brain/neural-computer interfaces (BNCI) have the potential to restore the capabilities of handicapped people to carry out activities of daily living. To improve applicability of such systems, workload and stress should be reduced to a minimal level. Here, we investigated the user’s physiological reactions during the exhaustive use of the interfaces of a hybrid control interface. Eleven BNCI-naive healthy volunteers participated in the experiments. All participants sat in a comfortable chair in front of a desk and wore a whole-arm exoskeleton as well as wearable devices for monitoring physiological, electroencephalographic (EEG) and electrooculographic (EoG) signals. The experimental protocol consisted of three phases: (i) Set-up, calibration and BNCI training; (ii) Familiarization phase; and (iii) Experimental phase during which each subject had to perform EEG and EoG tasks. After completing each task, the NASA-TLX questionnaire and self-assessment manikin (SAM) were completed by the user. We found significant differences (p-value < 0.05) in heart rate variability (HRV) and skin conductance level (SCL) between participants during the use of the two different biosignal modalities (EEG, EoG) of the BNCI. This indicates that EEG control is associated with a higher level of stress (associated with a decrease in HRV) and mental work load (associated with a higher level of SCL) when compared to EoG control. In addition, HRV and SCL modulations correlated with the subject’s workload perception and emotional responses assessed through NASA-TLX questionnaires and SAM.",
keywords = "Assistive technologies, Brain-computer interfaces, Exoskeleton",
author = "Badesa, {Francisco J.} and Diez, {Jorge A.} and Catalan, {Jose Maria} and Emilio Trigili and Francesca Cordella and Marius Nann and Simona Crea and Soekadar, {Surjo R.} and Loredana Zollo and Nicola Vitiello and Nicolas Garcia-Aracil",
year = "2019",
month = "11",
day = "2",
doi = "10.3390/s19224931",
language = "English",
volume = "19",
journal = "Sensors",
issn = "1424-3210",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "22",

}

TY - JOUR

T1 - Physiological responses during hybrid BNCI control of an upper-limb exoskeleton

AU - Badesa, Francisco J.

AU - Diez, Jorge A.

AU - Catalan, Jose Maria

AU - Trigili, Emilio

AU - Cordella, Francesca

AU - Nann, Marius

AU - Crea, Simona

AU - Soekadar, Surjo R.

AU - Zollo, Loredana

AU - Vitiello, Nicola

AU - Garcia-Aracil, Nicolas

PY - 2019/11/2

Y1 - 2019/11/2

N2 - When combined with assistive robotic devices, such as wearable robotics, brain/neural-computer interfaces (BNCI) have the potential to restore the capabilities of handicapped people to carry out activities of daily living. To improve applicability of such systems, workload and stress should be reduced to a minimal level. Here, we investigated the user’s physiological reactions during the exhaustive use of the interfaces of a hybrid control interface. Eleven BNCI-naive healthy volunteers participated in the experiments. All participants sat in a comfortable chair in front of a desk and wore a whole-arm exoskeleton as well as wearable devices for monitoring physiological, electroencephalographic (EEG) and electrooculographic (EoG) signals. The experimental protocol consisted of three phases: (i) Set-up, calibration and BNCI training; (ii) Familiarization phase; and (iii) Experimental phase during which each subject had to perform EEG and EoG tasks. After completing each task, the NASA-TLX questionnaire and self-assessment manikin (SAM) were completed by the user. We found significant differences (p-value < 0.05) in heart rate variability (HRV) and skin conductance level (SCL) between participants during the use of the two different biosignal modalities (EEG, EoG) of the BNCI. This indicates that EEG control is associated with a higher level of stress (associated with a decrease in HRV) and mental work load (associated with a higher level of SCL) when compared to EoG control. In addition, HRV and SCL modulations correlated with the subject’s workload perception and emotional responses assessed through NASA-TLX questionnaires and SAM.

AB - When combined with assistive robotic devices, such as wearable robotics, brain/neural-computer interfaces (BNCI) have the potential to restore the capabilities of handicapped people to carry out activities of daily living. To improve applicability of such systems, workload and stress should be reduced to a minimal level. Here, we investigated the user’s physiological reactions during the exhaustive use of the interfaces of a hybrid control interface. Eleven BNCI-naive healthy volunteers participated in the experiments. All participants sat in a comfortable chair in front of a desk and wore a whole-arm exoskeleton as well as wearable devices for monitoring physiological, electroencephalographic (EEG) and electrooculographic (EoG) signals. The experimental protocol consisted of three phases: (i) Set-up, calibration and BNCI training; (ii) Familiarization phase; and (iii) Experimental phase during which each subject had to perform EEG and EoG tasks. After completing each task, the NASA-TLX questionnaire and self-assessment manikin (SAM) were completed by the user. We found significant differences (p-value < 0.05) in heart rate variability (HRV) and skin conductance level (SCL) between participants during the use of the two different biosignal modalities (EEG, EoG) of the BNCI. This indicates that EEG control is associated with a higher level of stress (associated with a decrease in HRV) and mental work load (associated with a higher level of SCL) when compared to EoG control. In addition, HRV and SCL modulations correlated with the subject’s workload perception and emotional responses assessed through NASA-TLX questionnaires and SAM.

KW - Assistive technologies

KW - Brain-computer interfaces

KW - Exoskeleton

UR - http://www.scopus.com/inward/record.url?scp=85074809897&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074809897&partnerID=8YFLogxK

U2 - 10.3390/s19224931

DO - 10.3390/s19224931

M3 - Article

AN - SCOPUS:85074809897

VL - 19

JO - Sensors

JF - Sensors

SN - 1424-3210

IS - 22

M1 - 4931

ER -