Comparative analysis of language models in addressing syphilis-related queries.
Journal:
Medicina oral, patologia oral y cirugia bucal
Published Date:
Jul 1, 2025
Abstract
BACKGROUND: Syphilis, caused by Treponema pallidum, is a significant global health concern with potentially severe complications if untreated. Advances in artificial intelligence (AI), particularly large language models (LLMs), offer opportunities to enhance medical diagnosis and public health education. This study aims to assess LLMs' ability to provide readable, accurate, and comprehensive syphilis information by comparing it with WHO datasheets and validating through specialist evaluation for clinical relevance.