BRACTIVE: A Brain Activation Approach to Human Visual Brain Learning.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

The human brain is a highly efficient processing unit, and understanding how it works can inspire new algorithms and architectures in machine learning. In this work, we introduce a novel framework named Brain Activation Network (BRACTIVE), a transformer-based approach to studying the human visual brain. The primary objective of BRACTIVE is to align the visual features of subjects with their corresponding brain representations using functional Magnetic Resonance Imaging (fMRI) signals. It enables us to identify the brain's Regions of Interest (ROIs) in the subjects. Unlike previous brain research methods, which can only identify ROIs for one subject at a time and are limited by the number of subjects, BRACTIVE automatically extends this identification to multiple subjects and ROIs. Our experiments demonstrate that BRACTIVE effectively identifies person-specific regions of interest, such as face and body-selective areas, aligning with neuroscience findings and indicating potential applicability to various object categories. More importantly, we found that leveraging human visual brain activity to guide deep neural networks enhances performance across various benchmarks. It encourages the potential of BRACTIVE in both neuroscience and machine intelligence studies.

Authors

  • Xuan-Bac Nguyen
  • Hojin Jang
    Department of Brain and Cognitive Engineering, Korea University, Seoul, Republic of Korea.
  • Xin Li
    Veterinary Diagnostic Center, Shanghai Animal Disease Control Center, Shanghai, China.
  • Samee U Khan
  • Pawan Sinha
    Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, U.S.A. [email protected].
  • Khoa Luu
    CSCE Department, University of Arkansas, US.

Keywords

No keywords available for this article.