Artificial intelligence for clinical reasoning: the reliability challenge and path to evidence-based practice.

Journal: QJM : monthly journal of the Association of Physicians
Published Date:

Abstract

The integration of generative artificial intelligence (AI), particularly large language models (LLMs), into clinical reasoning heralds transformative potential for medical practice. However, their capacity to authentically replicate the complexity of human clinical decision-making remains uncertain-a challenge defined here as the reliability challenge. While studies demonstrate LLMs' ability to pass medical licensing exams and achieve diagnostic accuracy comparable to physicians, critical limitations persist. Crucially, LLMs mimic reasoning patterns rather than executing genuine logical reasoning, and their reliance on outdated or non-regional data undermines clinical relevance. To bridge this gap, we advocate for a synergistic paradigm where physicians leverage advanced clinical expertise while AI evolves toward transparency and interpretability. This requires AI systems to integrate real-time, context-specific evidence, align with local healthcare constraints, and adopt explainable architectures (e.g. multi-step reasoning frameworks or clinical knowledge graphs) to demystify decision pathways. Ultimately, reliable AI for clinical reasoning hinges on harmonizing technological innovation with human oversight, ensuring ethical adherence to beneficence and non-maleficence while advancing evidence-based, patient-centered care.

Authors

  • He Xu
    School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China.
  • Yueqing Wang
  • Yangqin Xun
    School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
  • Ruitai Shao
    School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
  • Yang Jiao
    Department of Neurology, The Second Affiliated Hospital, Harbin Medical University, Harbin, Heilongjiang Province, China.

Keywords

No keywords available for this article.