Comparison of Radiologists and Deep Learning for US Grading of Hepatic Steatosis.

Journal: Radiology
PMID: 37787678

Abstract

Background Screening for nonalcoholic fatty liver disease (NAFLD) is suboptimal due to the subjective interpretation of US images. Purpose To evaluate the agreement and diagnostic performance of radiologists and a deep learning model in grading hepatic steatosis in NAFLD at US, with biopsy as the reference standard. Materials and Methods This retrospective study included patients with NAFLD and control patients without hepatic steatosis who underwent abdominal US and contemporaneous liver biopsy from September 2010 to October 2019. Six readers visually graded steatosis on US images twice, 2 weeks apart. Reader agreement was assessed with use of κ statistics. Three deep learning techniques applied to B-mode US images were used to classify dichotomized steatosis grades. Classification performance of human radiologists and the deep learning model for dichotomized steatosis grades (S0, S1, S2, and S3) was assessed with area under the receiver operating characteristic curve (AUC) on a separate test set. Results The study included 199 patients (mean age, 53 years ± 13 [SD]; 101 men). On the test set ( = 52), radiologists had fair interreader agreement (0.34 [95% CI: 0.31, 0.37]) for classifying steatosis grades S0 versus S1 or higher, while AUCs were between 0.49 and 0.84 for radiologists and 0.85 (95% CI: 0.83, 0.87) for the deep learning model. For S0 or S1 versus S2 or S3, radiologists had fair interreader agreement (0.30 [95% CI: 0.27, 0.33]), while AUCs were between 0.57 and 0.76 for radiologists and 0.73 (95% CI: 0.71, 0.75) for the deep learning model. For S2 or lower versus S3, radiologists had fair interreader agreement (0.37 [95% CI: 0.33, 0.40]), while AUCs were between 0.52 and 0.81 for radiologists and 0.67 (95% CI: 0.64, 0.69) for the deep learning model. Conclusion Deep learning approaches applied to B-mode US images provided comparable performance with human readers for detection and grading of hepatic steatosis. Published under a CC BY 4.0 license. See also the editorial by Tuthill in this issue.

Authors

  • Pedro Vianna
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Sara-Ivana Calce
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Pamela Boustros
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Cassandra Larocque-Rigney
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Laurent Patry-Beaudoin
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Yi Hui Luo
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Emre Aslan
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • John Marinos
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Talal M Alamri
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Kim-Nhien Vu
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Jessica Murphy-Lavallée
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Jean-Sébastien Billiard
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Emmanuel Montagnon
  • Hongliang Li
  • Samuel Kadoury
    École Polytechnique de Montréal, Montreal, Canada. samuel.kadoury@polymtl.ca.
  • Bich N Nguyen
    Department of Pathology, Centre hospitalier de l'Université de Montréal (CHUM), Montréal, Québec, Canada.
  • Shanel Gauthier
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Benjamin Therien
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Irina Rish
    Department of Computer Science and Operations Research, Université de Montréal, Canada; Mila - Quebec AI Institute, Université de Montréal, Canada.
  • Eugene Belilovsky
    From the Department of Imaging and Engineering (P.V., S.I.C., C.L.R., L.P.B., E.M., H.L., S.K., M.C., G.C., A.T.), Laboratory of Biorheology and Medical Ultrasonics (P.V., G.C.), and Clinical Laboratory of Image Processing (E.M., A.T.), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Canada; Institute of Biomedical Engineering (P.V., G.C.) and Department of Computer Science and Operations Research (S.G., I.R., G.W.), Université de Montréal, Montréal, Canada; Departments of Radiology (S.I.C., P.B., C.L.R., L.P.B., Y.H.L., E.A., J.M., T.M.A., K.N.V., J.M.L., J.S.B., A.T.) and Pathology (B.N.N.), Centre Hospitalier de l'Université de Montréal (CHUM), 1058 rue Saint-Denis, Montréal, QC, Canada H2X 3J4; Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Canada (S.K.); Mila-Quebec Artificial Intelligence Institute, Montréal, Canada (S.G., B.T., I.R., E.B., G.W.); and Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada (B.T., E.B.).
  • Guy Wolf
    Department of Mathematics and Statistics, Université de Montréal, Montréal, Quebec, Canada.
  • Michaël Chassé
    Center for Integration and Analysis of Medical Data (CITADEL), Department of Medicine, University of Montreal, Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Montreal, Canada.
  • Guy Cloutier
  • An Tang
    Centre de recherche du Centre hospitalier de l'Université de Montréal (CRCHUM), Montreal, Canada.

Keywords

External Resources

Popular Topics
Recent Journals