Multi-receptor skin with highly sensitive tele-perception somatosensory.

Journal: Science advances
Published Date:

Abstract

The limitations and complexity of traditional noncontact sensors in terms of sensitivity and threshold settings pose great challenges to extend the traditional five human senses. Here, we propose tele-perception to enhance human perception and cognition beyond these conventional noncontact sensors. Our bionic multi-receptor skin employs structured doping of inorganic nanoparticles to enhance the local electric field, coupled with advanced deep learning algorithms, achieving a Δ/Δ sensitivity of 14.2, surpassing benchmarks. This enables precise remote control of surveillance systems and robotic manipulators. Our long short-term memory-based adaptive pulse identification achieves 99.56% accuracy in material identification with accelerated processing speeds. In addition, we demonstrate the feasibility of using a two-dimensional (2D) sensor matrix to integrate real object scan data into a convolutional neural network to accurately discriminate the shape and material of 3D objects. This promises transformative advances in human-computer interaction and neuromorphic computing.

Authors

  • Yan Du
    State Key Laboratory of Electroanalytical Chemistry, Changchun Institute of Applied Chemistry, Chinese Academy of Sciences, Changchun, Jilin 130022, China; School of Applied Chemistry and Engineering, University of Science and Technology of China, Hefei, Anhui 230026, China. Electronic address: duyan@ciac.ac.cn.
  • Penghui Shen
    School of Integrated Circuits and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 10084, China.
  • Houfang Liu
    School of Integrated Circuits and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 10084, China.
  • Yuyang Zhang
    College of Information Science and Engineering, Ningbo University, Ningbo 315211, China.
  • Luyao Jia
    Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, China.
  • Xiong Pu
    Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, China.
  • Feiyao Yang
    Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, China.
  • Tianling Ren
    Beijing National Research Center for Information Science and Technology, Institute of Microelectronics, Tsinghua University, Beijing 100084, China.
  • Daping Chu
    Centre for Photonic Devices and Sensors, University of Cambridge, 9 JJ Thomson Avenue, Cambridge CB3 0FA, UK.
  • Zhonglin Wang
    CAS Center for Excellence in Nanoscience, Beijing Key Laboratory of Micro-nano Energy and Sensor , Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences , Beijing 100083 , P.R. China.
  • Di Wei
    Guangxi Clinical Center for AIDS Prevention and Treatment, Chest Hospital of Guangxi Zhuang Autonomous Region, No. 8 Yangjiaoshan Road, Liuzhou, Guangxi, 545005, China.