The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications

Andrea Kübler, Elisa M. Holz, Angela Riccio, Claudia Zickler, Tobias Kaufmann, Sonja C. Kleih, Pit Staiger-Sälzer, Lorenzo Desideri, Evert Jan Hoogerwerf, Donatella Mattia

Research output: Contribution to journalArticle

Abstract

Albeit research on brain-computer interfaces (BCI) for controlling applications has expanded tremendously, we still face a translational gap when bringing BCI to end-users. To bridge this gap, we adapted the user-centered design (UCD) to BCI research and development which implies a shift from focusing on single aspects, such as accuracy and information transfer rate (ITR), to a more holistic user experience. The UCD implements an iterative process between end-users and developers based on a valid evaluation procedure. Within the UCD framework usability of a device can be defined with regard to its effectiveness, efficiency, and satisfaction. We operationalized these aspects to evaluate BCI-controlled applications. Effectiveness was regarded equivalent to accuracy of selections and efficiency to the amount of information transferred per time unit and the effort invested (workload). Satisfaction was assessed with questionnaires and visualanalogue scales. These metrics have been successfully applied to several BCI-controlled applications for communication and entertainment, which were evaluated by end-users with severe motor impairment. Results of four studies, involving a total of N519 end-users revealed: effectiveness was moderate to high; efficiency in terms of ITR was low to high and workload low to medium; depending on the match between user and technology, and type of application satisfaction was moderate to high. The here suggested evaluation metrics within the framework of the UCD proved to be an applicable and informative approach to evaluate BCI controlled applications, and end-users with severe impairment and in the locked-in state were able to participate in this process.

Original languageEnglish
Article numbere112392
JournalPLoS One
Volume9
Issue number12
DOIs
Publication statusPublished - Dec 3 2014

    Fingerprint

ASJC Scopus subject areas

  • Agricultural and Biological Sciences(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Medicine(all)

Cite this

Kübler, A., Holz, E. M., Riccio, A., Zickler, C., Kaufmann, T., Kleih, S. C., Staiger-Sälzer, P., Desideri, L., Hoogerwerf, E. J., & Mattia, D. (2014). The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications. PLoS One, 9(12), [e112392]. https://doi.org/10.1371/journal.pone.0112392