Optimal selective floor cleaning using deep learning algorithms and reconfigurable robot hTetro.

Journal: Scientific reports
Published Date:

Abstract

Floor cleaning robots are widely used in public places like food courts, hospitals, and malls to perform frequent cleaning tasks. However, frequent cleaning tasks adversely impact the robot's performance and utilize more cleaning accessories (such as brush, scrubber, and mopping pad). This work proposes a novel selective area cleaning/spot cleaning framework for indoor floor cleaning robots using RGB-D vision sensor-based Closed Circuit Television (CCTV) network, deep learning algorithms, and an optimal complete waypoints path planning method. In this scheme, the robot will clean only dirty areas instead of the whole region. The selective area cleaning/spot cleaning region is identified based on the combination of two strategies: tracing the human traffic patterns and detecting stains and trash on the floor. Here, a deep Simple Online and Real-time Tracking (SORT) human tracking algorithm was used to trace the high human traffic region and Single Shot Detector (SSD) MobileNet object detection framework for detecting the dirty region. Further, optimal shortest waypoint coverage path planning using evolutionary-based optimization was incorporated to traverse the robot efficiently to the designated selective area cleaning/spot cleaning regions. The experimental results show that the SSD MobileNet algorithm scored 90% accuracy for stain and trash detection on the floor. Further, compared to conventional methods, the evolutionary-based optimization path planning scheme reduces 15% percent of navigation time and 10% percent of energy consumption.

Authors

  • Balakrishnan Ramalingam
    Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore.
  • Anh Vu Le
    Optoelectronics Research Group, Faculty of Electrical and Electronics Engineering, Ton Duc Thang University, Ho Chi Minh City 700000, Vietnam.
  • Zhiping Lin
    School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, 639798, Singapore. Electronic address: ezplin@ntu.edu.sg.
  • Zhenyu Weng
    School of Electrical and Electronics Engineering, Nanyang Technological University, Singapore, 639798, Singapore.
  • Rajesh Elara Mohan
    Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore.
  • Sathian Pookkuttath
    Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore.