Object-of-Interest Perception in a Reconfigurable Rolling-Crawling Robot.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

Cebrenus Rechenburgi, a member of the huntsman spider family have inspired researchers to adopt different locomotion modes in reconfigurable robotic development. Object-of-interest perception is crucial for such a robot to provide fundamental information on the traversed pathways and guide its locomotion mode transformation. Therefore, we present a object-of-interest perception in a reconfigurable rolling-crawling robot and identifying appropriate locomotion modes. We demonstrate it in Scorpio, our in-house developed robot with two locomotion modes: rolling and crawling. We train the locomotion mode recognition framework, named Pyramid Scene Parsing Network (PSPNet), with a self-collected dataset composed of two categories paths, unobstructed paths (e.g., floor) for rolling and obstructed paths (e.g., with person, railing, stairs, static objects and wall) for crawling, respectively. The efficiency of the proposed framework has been validated with evaluation metrics in offline and real-time field trial tests. The experiment results show that the trained model can achieve an mIOU score of 72.28 and 70.63 in offline and online testing, respectively for both environments. The proposed framework's performance is compared with semantic framework (HRNet and Deeplabv3) where the proposed framework outperforms in terms of mIOU and speed. Furthermore, the experimental results has revealed that the robot's maneuverability is stable, and the proposed framework can successfully determine the appropriate locomotion modes with enhanced accuracy during complex pathways.

Authors

  • Archana Semwal
    Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore.
  • Melvin Ming Jun Lee
    Engineering Product Development, Singapore University of Technology and Design, Singapore 487372, Singapore.
  • Daniela Sánchez
    Tijuana Institute of Technology, Tijuana, BC, Mexico.
  • Sui Leng Teo
    Engineering Product Development, Singapore University of Technology and Design, Singapore 487372, Singapore.
  • Bo Wang
    Department of Clinical Laboratory Medicine Center, Inner Mongolia Autonomous Region People's Hospital, Hohhot, Inner Mongolia, China.
  • Rajesh Elara Mohan
    Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore.