Application of deep learning for image-based Chinese market food nutrients estimation.

Journal: Food chemistry
Published Date:

Abstract

With commercialization of deep learning (DL) models, daily precision dietary record based on images from smartphones becomes possible. This study took advantage of DL techniques on visual recognition tasks and proposed a suite of big-data-driven DL models regressing from food images to their nutrient estimation. We established and publicized the first food image database from the Chinese market, named ChinaMartFood-109. It contained 10,921 images with 23 nutrient contents, covering 18 main food groups. Inception V3 was optimized using other state-of-the-art deep convolutional neural networks, achieving up to 78 % and 94 % for top-1 and top-5 accuracy, respectively. Besides, this research compared three nutrient estimation algorithms and achieved the best regression coefficient (R) by normalization + AM compared with arithmetic mean and harmonic mean, validating applicability in practice as well as theory. These encouraging results provide further evidence supporting artificial intelligence in the field of food analysis.

Authors

  • Peihua Ma
    School of Agricultural Economics and Rural Development, Renmin University of China, Beijing 100872, China; Department of Nutrition and Food Science, College of Agriculture and Natural Resources, University of Maryland, College Park, MD 20740, United States.
  • Chun Pong Lau
    Department of Computer Science, Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, United States.
  • Ning Yu
    Department of Computing Sciences, The College at Brockport, State University of New York, 350 New Campus Drive, Brockport, 14420, NY, USA. nyu@brockport.edu.
  • An Li
    Maryland Applied Graduate Department of Robotics Engineering, Maryland Robotics Center, A. James Clark School College of Engineering, University of Maryland, College Park, MD 20742, United States.
  • Jiping Sheng
    School of Agricultural Economics and Rural Development, Renmin University of China, Beijing 100872, China. Electronic address: shengjiping@126.com.