AIMC Topic: Neurons

Clear Filters Showing 471 to 480 of 1388 articles

Successfully and efficiently training deep multi-layer perceptrons with logistic activation function simply requires initializing the weights with an appropriate negative mean.

Neural networks : the official journal of the International Neural Network Society
The vanishing gradient problem (i.e., gradients prematurely becoming extremely small during training, thereby effectively preventing a network from learning) is a long-standing obstacle to the training of deep neural networks using sigmoid activation...

A CMOS-memristor hybrid system for implementing stochastic binary spike timing-dependent plasticity.

Philosophical transactions. Series A, Mathematical, physical, and engineering sciences
This paper describes a fully experimental hybrid system in which a [Formula: see text] memristive crossbar spiking neural network (SNN) was assembled using custom high-resistance state memristors with analogue CMOS neurons fabricated in 180 nm CMOS t...

NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size.

IEEE transactions on pattern analysis and machine intelligence
Neural architecture search (NAS) has attracted a lot of attention and has been illustrated to bring tangible benefits in a large number of applications in the past few years. Architecture topology and architecture size have been regarded as two of th...

Experimental demonstration of highly reliable dynamic memristor for artificial neuron and neuromorphic computing.

Nature communications
Neuromorphic computing, a computing paradigm inspired by the human brain, enables energy-efficient and fast artificial neural networks. To process information, neuromorphic computing directly mimics the operation of biological neurons in a human brai...

A Novel Adaptive Linear Neuron Based on DNA Strand Displacement Reaction Network.

IEEE/ACM transactions on computational biology and bioinformatics
Analog DNA strand displacement circuits can be used to build artificial neural network due to the continuity of dynamic behavior. In this study, DNA implementations of novel catalysis, novel degradation and adjustment reaction modules are designed an...

Lag Synchronization of Noisy and Nonnoisy Multiple Neurobiological Coupled FitzHugh-Nagumo Networks with and without Delayed Coupling.

Computational intelligence and neuroscience
This paper presents a methodology for synchronizing noisy and nonnoisy multiple coupled neurobiological FitzHugh-Nagumo (FHN) drive and slave neural networks with and without delayed coupling, under external electrical stimulation (EES), external dis...

Printed synaptic transistor-based electronic skin for robots to feel and learn.

Science robotics
An electronic skin (e-skin) for the next generation of robots is expected to have biological skin-like multimodal sensing, signal encoding, and preprocessing. To this end, it is imperative to have high-quality, uniformly responding electronic devices...

The geometry of robustness in spiking neural networks.

eLife
Neural systems are remarkably robust against various perturbations, a phenomenon that still requires a clear explanation. Here, we graphically illustrate how neural networks can become robust. We study spiking networks that generate low-dimensional r...

Emergence of associative learning in a neuromorphic inference network.

Journal of neural engineering
. In the theoretical framework of predictive coding and active inference, the brain can be viewed as instantiating a rich generative model of the world that predicts incoming sensory data while continuously updating its parameters via minimization of...

Programming Molecular Systems To Emulate a Learning Spiking Neuron.

ACS synthetic biology
Hebbian theory seeks to explain how the neurons in the brain adapt to stimuli to enable learning. An interesting feature of Hebbian learning is that it is an unsupervised method and, as such, does not require feedback, making it suitable in contexts ...