AIMC Topic: Attention

Clear Filters Showing 111 to 120 of 587 articles

GlobalSR: Global context network for single image super-resolution via deformable convolution attention and fast Fourier convolution.

Neural networks : the official journal of the International Neural Network Society
Vision Transformer have achieved impressive performance in image super-resolution. However, they suffer from low inference speed mainly because of the quadratic complexity of multi-head self-attention (MHSA), which is the key to learning long-range d...

DualAttlog: Context aware dual attention networks for log-based anomaly detection.

Neural networks : the official journal of the International Neural Network Society
Most existing log-driven anomaly detection methods assume that logs are static and unchanged, which is often impractical. To address this, we propose a log anomaly detection model called DualAttlog. This model includes word-level and sequence-level s...

A Generalized Attention Mechanism to Enhance the Accuracy Performance of Neural Networks.

International journal of neural systems
In many modern machine learning (ML) models, attention mechanisms (AMs) play a crucial role in processing data and identifying significant parts of the inputs, whether these are text or images. This selective focus enables subsequent stages of the mo...

Integration of multi-level semantics in PTMs with an attention model for question matching.

PloS one
The task of question matching/retrieval focuses on determining whether two questions are semantically equivalent. It has garnered significant attention in the field of natural language processing (NLP) due to its commercial value. While neural networ...

Inter-participant transfer learning with attention based domain adversarial training for P300 detection.

Neural networks : the official journal of the International Neural Network Society
A Brain-computer interface (BCI) system establishes a novel communication channel between the human brain and a computer. Most event related potential-based BCI applications make use of decoding models, which requires training. This training process ...

Attention-based stackable graph convolutional network for multi-view learning.

Neural networks : the official journal of the International Neural Network Society
In multi-view learning, graph-based methods like Graph Convolutional Network (GCN) are extensively researched due to effective graph processing capabilities. However, most GCN-based methods often require complex preliminary operations such as sparsif...

DiagSWin: A multi-scale vision transformer with diagonal-shaped windows for object detection and segmentation.

Neural networks : the official journal of the International Neural Network Society
Recently, Vision Transformer and its variants have demonstrated remarkable performance on various computer vision tasks, thanks to its competence in capturing global visual dependencies through self-attention. However, global self-attention suffers f...

SFT-SGAT: A semi-supervised fine-tuning self-supervised graph attention network for emotion recognition and consciousness detection.

Neural networks : the official journal of the International Neural Network Society
Emotional recognition is highly important in the field of brain-computer interfaces (BCIs). However, due to the individual variability in electroencephalogram (EEG) signals and the challenges in obtaining accurate emotional labels, traditional method...

Infants' psychophysiological responses to eye contact with a human and with a humanoid robot.

Biological psychology
Eye contact with a human and with a humanoid robot elicits attention- and affect-related psychophysiological responses. However, these responses have mostly been studied in adults, leaving their developmental origin poorly understood. In this study, ...

Subject-independent auditory spatial attention detection based on brain topology modeling and feature distribution alignment.

Hearing research
Auditory spatial attention detection (ASAD) seeks to determine which speaker in a surround sound field a listener is focusing on based on the one's brain biosignals. Although existing studies have achieved ASAD from a single-trial electroencephalogra...