Deep and shallow architecture of multilayer neural networks.
Journal:
IEEE transactions on neural networks and learning systems
Published Date:
Jan 15, 2015
Abstract
This paper focuses on the deep and shallow architecture of multilayer neural networks (MNNs). The demonstration of whether or not an MNN can be replaced by another MNN with fewer layers is equivalent to studying the topological conjugacy of its hidden layers. This paper provides a systematic methodology to indicate when two hidden spaces are topologically conjugated. Furthermore, some criteria are presented for some specific cases.