Boosting Reservoir Computing with Brain-inspired Adaptive Dynamics
Journal:
arXiv
Published Date:
Apr 16, 2025
Abstract
Reservoir computers (RCs) provide a computationally efficient alternative to
deep learning while also offering a framework for incorporating brain-inspired
computational principles. By using an internal neural network with random,
fixed connections$-$the 'reservoir'$-$and training only the output weights, RCs
simplify the training process but remain sensitive to the choice of
hyperparameters that govern activation functions and network architecture.
Moreover, typical RC implementations overlook a critical aspect of neuronal
dynamics: the balance between excitatory and inhibitory (E-I) signals, which is
essential for robust brain function. We show that RCs characteristically
perform best in balanced or slightly over-inhibited regimes, outperforming
excitation-dominated ones. To reduce the need for precise hyperparameter
tuning, we introduce a self-adapting mechanism that locally adjusts E/I balance
to achieve target neuronal firing rates, improving performance by up to 130% in
tasks like memory capacity and time series prediction compared with globally
tuned RCs. Incorporating brain-inspired heterogeneity in target neuronal firing
rates further reduces the need for fine-tuning hyperparameters and enables RCs
to excel across linear and non-linear tasks. These results support a shift from
static optimization to dynamic adaptation in reservoir design, demonstrating
how brain-inspired mechanisms improve RC performance and robustness while
deepening our understanding of neural computation.