The three ghosts of medical AI: Can the black-box present deliver?

作者：

Highlights：

• Modern machine learning relies on powerful but intrinsically opaque models.

• When applied to the healthcare domain, these models fail to meet the needs for transparency.

• We review how opaque models lack quality assurance, fail to elicit trust, and restrict physician-patient dialogue.

• We then discuss how transparency in model design and validation can help ensure the reliability of medical AI.

摘要

•Modern machine learning relies on powerful but intrinsically opaque models.•When applied to the healthcare domain, these models fail to meet the needs for transparency.•We review how opaque models lack quality assurance, fail to elicit trust, and restrict physician-patient dialogue.•We then discuss how transparency in model design and validation can help ensure the reliability of medical AI.

论文关键词：Xai,Black-box,Ethics,Challenges,Transparency,Autonomy

论文评审过程：Received 7 January 2021, Revised 6 May 2021, Accepted 17 August 2021, Available online 28 August 2021, Version of Record 1 February 2022.

论文官网地址：https://doi.org/10.1016/j.artmed.2021.102158