Extracting clinical terms from radiology reports with deep learning.

Journal: Journal of biomedical informatics
Published Date:

Abstract

Extracting clinical terms from free-text format radiology reports is a first important step toward their secondary use. However, there is no general consensus on the kind of terms to be extracted. In this paper, we propose an information model comprising three types of clinical entities: observations, clinical findings, and modifiers. Furthermore, to determine its applicability for in-house radiology reports, we extracted clinical terms with state-of-the-art deep learning models and compared the results. We trained and evaluated models using 540 in-house chest computed tomography (CT) reports annotated by multiple medical experts. Two deep learning models were compared, and the effect of pre-training was explored. To investigate the generalizability of the model, we evaluated the use of other institutional chest CT reports. The micro F1-score of our best performance model using in-house and external datasets were 95.36% and 94.62%, respectively. Our results indicated that entities defined in our information model were suitable for extracting clinical terms from radiology reports, and the model was sufficiently generalizable to be used with dataset from other institutions.

Authors

  • Kento Sugimoto
    Department of Medical Informatics, Osaka University Graduate School of Medicine.
  • Toshihiro Takeda
    Department of Medical Informatics, Osaka University Graduate School of Medicine, Suita, Osaka, Japan.
  • Jong-Hoon Oh
    National Institute of Information and Communications Technology, Seika, Kyoto, Japan.
  • Shoya Wada
    Department of Medical Informatics, Osaka University Graduate School of Medicine, Suita, Osaka, Japan.
  • Shozo Konishi
    Department of Medical Informatics, Osaka University Graduate School of Medicine.
  • Asuka Yamahata
    Department of Medical Informatics, Osaka University Graduate School of Medicine.
  • Shiro Manabe
    Department of Medical Informatics, Osaka University Graduate School of Medicine, Suita, Osaka, Japan.
  • Noriyuki Tomiyama
    Diagnostic and Interventional Radiology, Osaka University Graduate School of Medicine, Suita, Osaka, Japan.
  • Takashi Matsunaga
    Department of Medical Informatics Osaka International Cancer Institute Osaka Japan.
  • Katsuyuki Nakanishi
    Department of Diagnostic and Interventional Radiology, Osaka International Cancer Institute, 3-1-69 Otemae, Chuo-ku, Osaka, 541-8567, Japan.
  • Yasushi Matsumura
    Department of Medical Informatics, Osaka University Graduate School of Medicine, Suita, Osaka, Japan.