Panch Trishan, Duralde Erin, Mattie Heather, Kotecha Gopal, Celi Leo Anthony, Wright Melanie, Greaves Felix
Division of Health Policy and Management, Harvard T.H. Chan School of Public Health, Harvard University, Boston, Massachusetts.
Wellframe Inc., Boston, Massachusetts.
PLOS Digit Health. 2022 May 26;1(5):e0000040. doi: 10.1371/journal.pdig.0000040. eCollection 2022 May.
Regulation is necessary to ensure the safety, efficacy and equitable impact of clinical artificial intelligence (AI). The number of applications of clinical AI is increasing, which, amplified by the need for adaptations to account for the heterogeneity of local health systems and inevitable data drift, creates a fundamental challenge for regulators. Our opinion is that, at scale, the incumbent model of centralized regulation of clinical AI will not ensure the safety, efficacy, and equity of implemented systems. We propose a hybrid model of regulation, where centralized regulation would only be required for applications of clinical AI where the inference is entirely automated without clinician review, have a high potential to negatively impact the health of patients and for algorithms that are to be applied at national scale by design. This amalgam of centralized and decentralized regulation we refer to as a distributed approach to the regulation of clinical AI and highlight the benefits as well as the pre-requisites and challenges involved.
监管对于确保临床人工智能(AI)的安全性、有效性和公平影响是必要的。临床AI的应用数量正在增加,由于需要适应地方卫生系统的异质性以及不可避免的数据漂移,这给监管机构带来了根本性挑战。我们认为,从规模上讲,现有的临床AI集中监管模式无法确保已实施系统的安全性、有效性和公平性。我们提出一种混合监管模式,即仅对那些推理完全自动化且无需临床医生审核、对患者健康有很大负面影响可能性以及按设计将在全国范围内应用的算法的临床AI应用才需要集中监管。我们将这种集中监管与分散监管的融合称为临床AI监管的分布式方法,并强调其好处以及涉及的先决条件和挑战。