Potenziali conseguenze inattese dell'uso di sistemi di intelligenza artificiale oracolari in medicina

Translated title of the contribution: “Handle with care”: About the potential unintended consequences of oracular artificial intelligence systems in medicine

Federico Cabitza, Camilla Alderighi, Raffaele Rasoini, Gian Franco Gensini

Research output: Contribution to journalReview article

Abstract

Decisional support systems based on machine learning (ML) in medicine are gaining a growing interest as some recent articles have highlighted the high diagnostic accuracy exhibited by these systems in specific medical contexts. However, it is implausible that any potential advantage can be obtained without some potential drawbacks. In light of the current gaps in medical research about the side effects of the application of these new AI systems in medical practice, in this article we summarize the main unexpected consequences that may result from the widespread application of "oracular" systems, that is highly accurate systems that cannot give reasonable explanations of their advice as those endowed with predictive models developed with ML techniques usually are. These consequences range from the intrinsic uncertainty in the data that are used to train and feed these systems, to the inadequate explainability of their output; through the risk of overreliance, deskilling and context desensitization of their end-users. Although some of these issues may be currently hard to evaluate due to the still scarce adoption of these decisional systems in medical practice, we advocate the study of these potential consequences also for a more informed policy of approval beyond hype and disenchantment.

Translated title of the contribution“Handle with care”: About the potential unintended consequences of oracular artificial intelligence systems in medicine
Original languageItalian
Pages (from-to)397-401
Number of pages5
JournalRecenti Progressi in Medicina
Volume108
Issue number10
Publication statusPublished - Oct 1 2017

ASJC Scopus subject areas

  • Medicine(all)

Fingerprint Dive into the research topics of '“Handle with care”: About the potential unintended consequences of oracular artificial intelligence systems in medicine'. Together they form a unique fingerprint.

  • Cite this

    Cabitza, F., Alderighi, C., Rasoini, R., & Gensini, G. F. (2017). Potenziali conseguenze inattese dell'uso di sistemi di intelligenza artificiale oracolari in medicina. Recenti Progressi in Medicina, 108(10), 397-401.