Home
Scholarly Works
Reporting guidelines for chatbot health advice...
Journal article

Reporting guidelines for chatbot health advice studies: explanation and elaboration for the Chatbot Assessment Reporting Tool (CHART)

Abstract

The Chatbot Assessment Reporting Tool (CHART) reporting guideline promotes transparent and comprehensive reporting of studies evaluating the performance of generative artificial intelligence (AI)-driven chatbots for the purposes of summarising clinical evidence and providing health advice, referred to here as chatbot health advice (CHA) studies. CHART is the product of an international, multi-phase, consensus based initiative involving various stakeholders and comprises a 12-item checklist with 39 subitems. The checklist includes items on open science, title and abstract, introduction, model identification, model details, prompt engineering, query strategy, performance definition and evaluation, statistical analysis, results, discussion, with an accompanying flow diagram. Each item includes distinct subitems. This explanation and elaboration article discusses each subitem and provides a detailed rationale for its inclusion in the CHART checklist.

Authors

Huo B; Thirunavukarasu AJ; Collins GS; Chartash D; Flanagin A; Iorio A; Cacciamani G; Chen X; Liu N; Mathur P

Journal

The BMJ, Vol. 390, ,

Publisher

BMJ

Publication Date

January 1, 2025

DOI

10.1136/bmj-2024-083305

ISSN

0959-8138

Contact the Experts team