Using Advanced Convolutional Neural Network Approaches to Reveal Patient Age, Gender, and Weight Based on Tongue Images.

Journal: BioMed research international
PMID:

Abstract

The human tongue has been long believed to be a window to provide important insights into a patient's health in medicine. The present study introduced a novel approach to predict patient age, gender, and weight inferences based on tongue images using pretrained deep convolutional neural networks (CNNs). Our results demonstrated that the deep CNN models (e.g., ResNeXt) trained on dorsal tongue images produced excellent results for age prediction with a Pearson correlation coefficient of 0.71 and a mean absolute error (MAE) of 8.5 years. We also obtained an excellent classification of gender, with a mean accuracy of 80% and an AUC (area under the receiver operating characteristic curve) of 88%. ResNeXt model also obtained a moderate level of accuracy for weight prediction, with a Pearson correlation coefficient of 0.39 and a MAE of 9.06 kg. These findings support our hypothesis that the human tongue contains crucial information about a patient. This study demonstrated the feasibility of using the pretrained deep CNNs along with a large tongue image dataset to develop computational models to predict patient medical conditions for noninvasive, convenient, and inexpensive patient health monitoring and diagnosis.

Authors

  • Xiaoyan Li
    Shulan International Medical College, Zhejiang Shuren University, Hangzhou, Zhejiang, China.
  • Li Li
    Department of Gastric Surgery, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China.
  • Jing Wei
    School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, Guangdong, China.
  • Pengwei Zhang
    College of Agricultural Engineering and Food Science, Shandong University of Technology, No. 266 Xincun Xilu, Zibo, Shandong 255049, China.
  • Volodymyr Turchenko
    Nuralogix Corp., Toronto, Ontario, Canada.
  • Naresh Vempala
    Nuralogix Corp., Toronto, Ontario, Canada.
  • Evgueni Kabakov
    Nuralogix Corp., Toronto, Ontario, Canada.
  • Faisal Habib
    Mathematics, Analytics, and Data Science Lab Fields Institute for Research in Mathematical Sciences, Toronto, Ontario, Canada.
  • Arvind Gupta
    Computer Science University of Toronto, Toronto, Ontario, Canada.
  • Huaxiong Huang
    Department of Mathematics and Statistics, York University, 4700 Keele Street, Toronto, Ontario, M3J 1P3, Canada.
  • Kang Lee
    Dr. Eric Jackman Institute of Child Study, University of Toronto, Toronto, M5R 2X2, Canada. kang.lee@utoronto.ca.