A systematic review has been conducted to assess the reporting completeness of randomized controlled trials (RCTs) of artificial intelligence interventions (AI) following the publication of the Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI). The CONSORT-AI was published in September 2020, and since then, several RCTs of AI interventions have been published. However, the transparency and completeness of their reporting have been unknown until now.
The review identified 65 RCTs, the majority of which were conducted in China (37%) and the USA (18%). The median agreement with CONSORT-AI reporting was 90%, although only 10 RCTs explicitly reported its use. Despite the high level of compliance, the review found that several aspects were consistently under-reported.
A Critical Look at the Reporting of Artificial Intelligence Intervention Trials
These under-reported items included the version of the algorithm used, the accessibility of the AI intervention or code, and references to a study protocol. Only three out of the 52 journals included in the review explicitly endorsed or mandated the use of CONSORT-AI guidelines. This indicates that there may be a lack of awareness or adoption of these guidelines in the wider scientific community.
Despite the generally high agreement with the CONSORT-AI guidelines in recent AI RCTs, some AI-specific considerations remain systematically poorly reported. The review suggests that further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
Original Article DOI: 10.1038/s41467-024-45355-3
Original title: Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines
This article has been prepared with the assistance of AI and reviewed by an editor. For more details, please refer to our Terms and Conditions. We do not accept any responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you have any complaints or copyright issues related to this article, kindly contact the author.
