Towards expert-level autonomous carotid ultrasonography with large-scale learning-based robotic system.

Journal: Nature communications
Published Date:

Abstract

Carotid ultrasound requires skilled operators due to small vessel dimensions and high anatomical variability, exacerbating sonographer shortages and diagnostic inconsistencies. Prior automation attempts, including rule-based approaches with manual heuristics and reinforcement learning trained in simulated environments, demonstrate limited generalizability and fail to complete real-world clinical workflows. Here, we present UltraBot, a fully learning-based autonomous carotid ultrasound robot, achieving human-expert-level performance through four innovations: (1) A unified imitation learning framework for acquiring anatomical knowledge and scanning operational skills; (2) A large-scale expert demonstration dataset (247,000 samples, 100 × scale-up), enabling embodied foundation models with strong generalization; (3) A comprehensive scanning protocol ensuring full anatomical coverage for biometric measurement and plaque screening; (4) The clinical-oriented validation showing over 90% success rates, expert-level accuracy, up to 5.5 × higher reproducibility across diverse unseen populations. Overall, we show that large-scale deep learning offers a promising pathway toward autonomous, high-precision ultrasonography in clinical practice.

Authors

  • Haojun Jiang
  • Andrew Zhao
    Department of Automation, BNRist, Tsinghua University, China. Electronic address: andrewzhao112@gmail.com.
  • Qian Yang
    Center for Advanced Scientific Instrumentation, University of Wyoming, Laramie, WY, United States.
  • Xiangjie Yan
    Department of Automation, Tsinghua University, Beijing, China.
  • Teng Wang
    Department of Nutrition and food hygiene, College of Public Health of Zhengzhou University, Zhengzhou, China, 450001. Electronic address: 530327182@qq.com.
  • Yulin Wang
    Department of Automation, Tsinghua University, Beijing, China.
  • Ning Jia
    College of Education, Hebei Normal University, Shijiazhuang, 050024, China. jianing@hebtu.edu.cn.
  • Jiangshan Wang
    Department of Agricultural and Biological Engineering, Purdue University, West Lafayette, Indiana, United States of America.
  • Guokun Wu
    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China.
  • Yang Yue
    Department of Obstetrics, Longhua District Maternity and Child Health Hospital, Shenzhen City, China.
  • Shaqi Luo
    Beijing Academy of Artificial Intelligence, Beijing, China.
  • Huanqian Wang
    Department of Automation, Tsinghua University, Beijing, China.
  • Ling Ren
    State Key Laboratory of Oral Diseases & National Center for Stomatology & National Clinical Research Center for Oral Diseases & Research Unit of Oral Carcinogenesis and Management, Chinese Academy of Medical Sciences, West China Hospital of Stomatology, Sichuan University, Chengdu, Sichuan 610041, PR China.
  • Siming Chen
  • Pan Liu
    Jiangsu Key Laboratory of Urban ITS, Southeast University, Si Pai Lou #2, Nanjing, 210096, China; Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, Si Pai Lou #2, Nanjing, 210096, China. Electronic address: pan_liu@hotmail.com.
  • Guocai Yao
    Beijing Academy of Artificial Intelligence, Beijing, China.
  • Wenming Yang
  • Shiji Song
  • Xiang Li
    Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, United States.
  • Kunlun He
    Beijing Key Laboratory of Precision Medicine for Chronic Heart Failure, Chinese PLA General Hospital, Beijing, China.
  • Gao Huang
    Department of Automation, Tsinghua University, Beijing 100084, China. huang-g09@mails.tsinghua.edu.cn