Ophthalmology

Brain Mapping with Dense Features: Grounding Cortical Semantic Selectivity in Natural Images With Vision Transformers

Advances in large-scale artificial neural networks have facilitated novel insights into the functional topology of the brain. Here, we leverage this approach to study how semantic categories are organized in the human visual cortex. To overcome the challenge presented by the co-occurrence of multiple categories in natural images, we introduce BrainSAIL (Semantic Attribution and Image Localizatio...

Control-oriented Clustering of Visual Latent Representation

We initiate a study of the geometry of the visual representation space -- the information channel from the vision encoder to the action decoder -- in an image-based control pipeline learned from behavior cloning. Inspired by the phenomenon of neural collapse (NC) in image classification (arXiv:2008.08186), we empirically demonstrate the prevalent emergence of a similar law of clustering in the v...

The Visualization JUDGE : Can Multimodal Foundation Models Guide Visualization Design Through Visual Perception?

Foundation models for vision and language are the basis of AI applications across numerous sectors of society. The success of these models stems fro...

Fast Object Detection with a Machine Learning Edge Device

This machine learning study investigates a lowcost edge device integrated with an embedded system having computer vision and resulting in an improve...

Multi-level Memory-Centric Profiling on ARM Processors with ARM SPE

High-end ARM processors are emerging in data centers and HPC systems, posing as a strong contender to x86 machines. Memory-centric profiling is an i...

A Computational Fluid Dynamics study of drug-releasing ocular implants for glaucoma treatment: Comparison of implant size and locations

Drug-releasing implants are gaining momentum in the treatment of glaucoma. Implants present however several limitations. Among these limitations, th...

Insight: A Multi-Modal Diagnostic Pipeline using LLMs for Ocular Surface Disease Diagnosis

Accurate diagnosis of ocular surface diseases is critical in optometry and ophthalmology, which hinge on integrating clinical data sources (e.g., me...

Dual-channel lightweight GAN for enhancing color retinal images with noise suppression and structural protection.

As we all know, suppressing noise while maintaining detailed structure has been a challenging problem in the field of image enhancement, especially fo...

Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network

Recent advances in deep learning-based image reconstruction techniques have led to significant progress in phase retrieval using digital in-line hol...

Understanding Clinical Decision-Making in Traditional East Asian Medicine through Dimensionality Reduction: An Empirical Investigation

This study examines the clinical decision-making processes in Traditional East Asian Medicine (TEAM) by reinterpreting pattern identification (PI) t...

Looking through the mind's eye via multimodal encoder-decoder networks

In this work, we explore the decoding of mental imagery from subjects using their fMRI measurements. In order to achieve this decoding, we first cre...

From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generation

Video encompasses both visual and auditory data, creating a perceptually rich experience where these two modalities complement each other. As such, ...

EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing

Eye-tracking technology has gained significant attention in recent years due to its wide range of applications in human-computer interaction, virtua...

Robotic Environmental State Recognition with Pre-Trained Vision-Language Models and Black-Box Optimization

In order for robots to autonomously navigate and operate in diverse environments, it is essential for them to recognize the state of their environme...

Active Vision Might Be All You Need: Exploring Active Vision in Bimanual Robotic Manipulation

Imitation learning has demonstrated significant potential in performing high-precision manipulation tasks using visual feedback. However, it is comm...

Optical Lens Attack on Deep Learning Based Monocular Depth Estimation

Monocular Depth Estimation (MDE) plays a crucial role in vision-based Autonomous Driving (AD) systems. It utilizes a single-camera image to determin...

Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in me...

VascX Models: Model Ensembles for Retinal Vascular Analysis from Color Fundus Images

We introduce VascX models, a comprehensive set of model ensembles for analyzing retinal vasculature from color fundus images (CFIs). Annotated CFIs ...

An initial game-theoretic assessment of enhanced tissue preparation and imaging protocols for improved deep learning inference of spatial transcriptomics from tissue morphology.

The application of deep learning to spatial transcriptomics (ST) can reveal relationships between gene expression and tissue architecture. Prior work ...

ViTGuard: Attention-aware Detection against Adversarial Examples for Vision Transformer

The use of transformers for vision tasks has challenged the traditional dominant role of convolutional neural networks (CNN) in computer vision (CV)...