State transition learning with limited data for safe control of switched nonlinear systems.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Switching dynamics are prevalent in real-world systems, arising from either intrinsic changes or responses to external influences, which can be appropriately modeled by switched systems. Control synthesis for switched systems, especially integrating safety constraints, is recognized as a significant and challenging topic. This study focuses on devising a learning-based control strategy for switched nonlinear systems operating under arbitrary switching law. It aims to maintain stability and uphold safety constraints despite limited system data. To achieve these goals, we employ the control barrier function method and Lyapunov theory to synthesize a controller that delivers both safety and stability performance. To overcome the difficulties associated with constructing the specific control barrier and Lyapunov function and take advantage of switching characteristics, we create a neural control barrier function and a neural Lyapunov function separately for control policies through a state transition learning approach. These neural barrier and Lyapunov functions facilitate the design of the safe controller. The corresponding control policy is governed by learning from two components: policy loss and forward state estimation. The effectiveness of the developing scheme is verified through simulation examples.

Authors

  • Chenchen Fan
    Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hung Hom, Hong Kong, China.
  • Kai-Fung Chu
    Department of Engineering, University of Cambridge, Trumpington Street, Cambridge, CB2 1PZ, UK. Electronic address: kfc35@cam.ac.uk.
  • Xiaomei Wang
    The Department of Mechanical Engineering, The University of Hong Kong, Pokfulam, Hong Kong.
  • Ka-Wai Kwok
    Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, Hong Kong SAR, China.
  • Fumiya Iida
    Institute of Robotics and Intelligent Systems, Department of Mechanical and Process Engineering, ETH Zürich, 8092 Zürich, Switzerland; Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, United Kingdom.