Tools
Tools
Alabed, Samer, Maiter, Ahmed, Salehi, Mahan, Mahmood, Aqeeb, Daniel, Sonali, Jenkins, Sam, Goodlad, Marcus, Sharkey, Michael, Mamalakis, Michail, Rakocevic, Vera, Dwivedi, Krit, Assadi, Hosamadin 
ORCID: https://orcid.org/0000-0002-6143-8095, Wild, Jim M., Lu, Haiping, O'Regan, Declan P., van der Geest, Rob J., Garg, Pankaj ORCID: https://orcid.org/0000-0002-5483-169X and Swift, Andrew J.
(2022)
Quality of reporting in AI cardiac MRI segmentation studies - A systematic review and recommendations for future studies.
Frontiers in Cardiovascular Medicine, 9.
ISSN 2297-055X
Preview |
PDF (fcvm-09-956811)
- Published Version
Available under License Creative Commons Attribution. Download (7MB) | Preview |
Abstract
Background: There has been a rapid increase in the number of Artificial Intelligence (AI) studies of cardiac MRI (CMR) segmentation aiming to automate image analysis. However, advancement and clinical translation in this field depend on researchers presenting their work in a transparent and reproducible manner. This systematic review aimed to evaluate the quality of reporting in AI studies involving CMR segmentation. Methods: MEDLINE and EMBASE were searched for AI CMR segmentation studies in April 2022. Any fully automated AI method for segmentation of cardiac chambers, myocardium or scar on CMR was considered for inclusion. For each study, compliance with the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) was assessed. The CLAIM criteria were grouped into study, dataset, model and performance description domains. Results: 209 studies published between 2012 and 2022 were included in the analysis. Studies were mainly published in technical journals (58%), with the majority (57%) published since 2019. Studies were from 37 different countries, with most from China (26%), the USA (18%) and the UK (11%). Short axis CMR images were most frequently used (70%), with the left ventricle the most commonly segmented cardiac structure (49%). Median compliance of studies with CLAIM was 67% (IQR 59-73%). Median compliance was highest for the model description domain (100%, IQR 80-100%) and lower for the study (71%, IQR 63-86%), dataset (63%, IQR 50-67%) and performance (60%, IQR 50-70%) description domains. Conclusion: This systematic review highlights important gaps in the literature of CMR studies using AI. We identified key items missing - most strikingly poor description of patients included in the training and validation of AI models and inadequate model failure analysis - that limit the transparency, reproducibility and hence validity of published AI studies. This review may support closer adherence to established frameworks for reporting standards and presents recommendations for improving the quality of reporting in this field. (PROSPERO registration number: CRD42022279214)
| Item Type: | Article |
|---|---|
| Additional Information: | Funding: This study was supported by the NIHR grant AI_AWARD01706, Wellcome Trust grants 215799/Z/19/Z and 205188/Z/16/Z, Medical Research Council grant MC-A658-5QEB0, and British Heart Foundation grant RG/19/6/34387. The funders did not have any role in the design and conduct of the study; in the collection, analysis, and interpretation of the data; or in the preparation, review, and approval of the manuscript. |
| Uncontrolled Keywords: | artificial intelligence,machine learning,segmentation,cardiac mri,systematic review,quality,reporting,cardiology and cardiovascular medicine ,/dk/atira/pure/subjectarea/asjc/2700/2705 |
| Faculty \ School: | Faculty of Medicine and Health Sciences > Norwich Medical School |
| UEA Research Groups: | Faculty of Medicine and Health Sciences > Research Centres > Metabolic Health |
| Related URLs: | |
| Depositing User: | LivePure Connector |
| Date Deposited: | 13 Jul 2022 09:30 |
| Last Modified: | 19 Oct 2023 03:22 |
| URI: | https://ueaeprints.uea.ac.uk/id/eprint/86087 |
| DOI: | 10.3389/fcvm.2022.956811 |
Downloads
Downloads per month over past year
Actions (login required)
 |
View Item |