Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing.

Journal: Nature communications
PMID:

Abstract

The capacity to discern and locate positions in three-dimensional space is crucial for human-machine interfaces and robotic perception. However, current soft electronics can only obtain two-dimensional spatial locations through physical contact. In this study, we report a non-contact position targeting concept enabled by transparent and thin soft electronic skin (E-skin) with three-dimensional sensing capabilities. Inspired by the active electrosensation of mormyroidea fish, this E-skin actively ascertains the 3D positions of targeted objects in a contactless manner and can wirelessly convey the corresponding positions to other devices in real-time. Consequently, this E-skin readily enables interaction with machines, i.e., manipulating virtual objects, controlling robotic arms, and drones in either virtual or actual 3D space. Additionally, it can be integrated with robots to provide them with 3D situational awareness for perceiving their surroundings, avoiding obstacles, or tracking targets.

Authors

  • Jingkun Zhou
    Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China.
  • Jian Li
    Fujian Key Laboratory of Traditional Chinese Veterinary Medicine and Animal Health, College of Animal Science, Fujian Agriculture and Forestry University, Fuzhou, China.
  • Huiling Jia
    Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China.
  • Kuanming Yao
    Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China.
  • Shengxin Jia
    Department of Biomedical Engineering, City University of Hong Kong, Kowloong Tong, Hong Kong, China.
  • Jiyu Li
    Shanghai Tenth People's Hospital, Shanghai, China.
  • Guangyao Zhao
    Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China.
  • Chun Ki Yiu
    Department of Biomedical Engineering, City University of Hong Kong, Kowloong Tong, Hong Kong, China.
  • Zhan Gao
    State Key Laboratory of Cardiovascular Disease, Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100037, China.
  • Dengfeng Li
    School of Economics and Management, Fuzhou University, Fuzhou, Fujian, China.
  • Binbin Zhang
    Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China.
  • Ya Huang
  • Qiuna Zhuang
    Laboratory for Advanced Interfacial Materials and Devices, Department of Applied Biology and Chemical Technology, The Hong Kong Polytechnic University, Hong Kong, China.
  • Yawen Yang
    Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China.
  • Xingcan Huang
    Department of Biomedical Engineering, City University of Hong Kong, Kowloong Tong, Hong Kong, China.
  • Mengge Wu
    Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China.
  • Yiming Liu
  • Yuyu Gao
    Department of Biomedical Engineering, City University of Hong Kong, Kowloong Tong, Hong Kong, China.
  • Hu Li
    School of Business, Qingdao University, Qingdao, Shandong, China.
  • Yue Hu
    Department of Biobank, China-Japan Union Hospital of Jilin University, Changchun, China.
  • Rui Shi
    From the Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, 2nd Anzhen Road, Chaoyang District, Beijing, China (N.Z., L.X., Z.F.); Cardiovascular Research Centre, Royal Brompton Hospital, London, England (G.Y., R.S., J.K., D.F.); National Heart and Lung Institute, Imperial College London, London, England (G.Y., R.S., J.K., D.F.); Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China (Z.G., H.Z.); Anhui University, Hefei, China (C.X., Y.Z.); and School of Biomedical Engineering, Sun Yat-Sen University, Shenzhen, China (H.Z.).
  • Meenakshi Mukherji
    Department of Electrical Engineering, City University of Hong Kong, Hong Kong, China.
  • Zijian Zheng
    Department of Neurosurgery, National Regional Medical Center, Binhai Campus of the First Affiliated Hospital, Fujian Medical University, Fuzhou, Fujian, China.
  • Xinge Yu
    Department of Biomedical Engineering, City University of Hong Kong, Kowloong Tong, Hong Kong, China. xingeyu@cityu.edu.hk.