AIMC Topic: Information Theory

Clear Filters Showing 21 to 30 of 40 articles

Evaluating information-theoretic measures of word prediction in naturalistic sentence reading.

Neuropsychologia
We review information-theoretic measures of cognitive load during sentence processing that have been used to quantify word prediction effort. Two such measures, surprisal and next-word entropy, suffer from shortcomings when employed for a predictive ...

Using intersection information to map stimulus information transfer within neural networks.

Bio Systems
Analytical tools that estimate the directed information flow between simultaneously recorded neural populations, such as directed information or Granger causality, typically focus on measuring how much information is exchanged between such population...

Adaptive Learning Emotion Identification Method of Short Texts for Online Medical Knowledge Sharing Community.

Computational intelligence and neuroscience
The medical knowledge sharing community provides users with an open platform for accessing medical resources and sharing medical knowledge, treatment experience, and emotions. Compared with the recipients of general commodities, the recipients in the...

Learning Domain-Independent Deep Representations by Mutual Information Minimization.

Computational intelligence and neuroscience
Domain transfer learning aims to learn common data representations from a source domain and a target domain so that the source domain data can help the classification of the target domain. Conventional transfer representation learning imposes the dis...

Integrated information in the thermodynamic limit.

Neural networks : the official journal of the International Neural Network Society
The capacity to integrate information is a prominent feature of biological, neural, and cognitive processes. Integrated Information Theory (IIT) provides mathematical tools for quantifying the level of integration in a system, but its computational c...

f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks.

Medical image analysis
Obtaining expert labels in clinical imaging is difficult since exhaustive annotation is time-consuming. Furthermore, not all possibly relevant markers may be known and sufficiently well described a priori to even guide annotation. While supervised le...

Information flow reveals prediction limits in online social activity.

Nature human behaviour
Modern society depends on the flow of information over online social networks, and users of popular platforms generate substantial behavioural data about themselves and their social ties. However, it remains unclear what fundamental limits exist when...

Information-Based Boundary Equilibrium Generative Adversarial Networks with Interpretable Representation Learning.

Computational intelligence and neuroscience
This paper describes a new image generation algorithm based on generative adversarial network. With an information-theoretic extension to the autoencoder-based discriminator, this new algorithm is able to learn interpretable representations from the ...

Information-theoretic decomposition of embodied and situated systems.

Neural networks : the official journal of the International Neural Network Society
The embodied and situated view of cognition stresses the importance of real-time and nonlinear bodily interaction with the environment for developing concepts and structuring knowledge. In this article, populations of robots controlled by an artifici...

Scale-Limited Lagrange Stability and Finite-Time Synchronization for Memristive Recurrent Neural Networks on Time Scales.

IEEE transactions on cybernetics
The existed results of Lagrange stability and finite-time synchronization for memristive recurrent neural networks (MRNNs) are scale-free on time evolvement, and some restrictions appear naturally. In this paper, two novel scale-limited comparison pr...