Ophthalmology

Artificial Intelligence Versus Rules-Based Approach for Segmenting NonPerfusion Area in a DRCR Retina Network Optical Coherence Tomography Angiography Dataset.

PURPOSE: Loss of retinal perfusion is associated with both onset and worsening of diabetic retinopathy (DR). Optical coherence tomography angiography is a noninvasive method for measuring the nonperfusion area (NPA) and has promise as a scalable screening tool. This study compares two optical coherence tomography angiography algorithms for quantifying NPA.

Multimodal Artificial Intelligence Models Predicting Glaucoma Progression Using Electronic Health Records and Retinal Nerve Fiber Layer Scans.

PURPOSE: The purpose of this study was to develop models that predict which patients with glaucoma will progress to require surgery, combining structured data from electronic health records (EHRs) and retinal fiber layer optical coherence tomography (RNFL OCT) scans.

A Comparison of Object Detection and Phrase Grounding Models in Chest X-ray Abnormality Localization using Eye-tracking Data

Chest diseases rank among the most prevalent and dangerous global health issues. Object detection and phrase grounding deep learning models interpre...

MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations

Despite significant progress in Vision-Language Pre-training (VLP), current approaches predominantly emphasize feature extraction and cross-modal co...

FunBench: Benchmarking Fundus Reading Skills of MLLMs

Multimodal Large Language Models (MLLMs) have shown significant potential in medical image analysis. However, their capabilities in interpreting fun...

DoF-Gaussian: Controllable Depth-of-Field for 3D Gaussian Splatting

Recent advances in 3D Gaussian Splatting (3D-GS) have shown remarkable success in representing 3D scenes and generating high-quality, novel views in...

Multi-Cali Anything: Dense Feature Multi-Frame Structure-from-Motion for Large-Scale Camera Array Calibration

Calibrating large-scale camera arrays, such as those in dome-based setups, is time-intensive and typically requires dedicated captures of known patt...

Dur360BEV: A Real-world 360-degree Single Camera Dataset and Benchmark for Bird-Eye View Mapping in Autonomous Driving

We present Dur360BEV, a novel spherical camera autonomous driving dataset equipped with a high-resolution 128-channel 3D LiDAR and a RTK-refined GNS...

Simulation of prosthetic vision with PRIMA system and enhancement of face representation

Objective. Patients implanted with the PRIMA photovoltaic subretinal prosthesis in geographic atrophy report form vision with the average acuity mat...

Urban Safety Perception Through the Lens of Large Multimodal Models: A Persona-based Approach

Understanding how urban environments are perceived in terms of safety is crucial for urban planning and policymaking. Traditional methods like surve...

Detection of Customer Interested Garments in Surveillance Video using Computer Vision

One of the basic requirements of humans is clothing and this approach aims to identify the garments selected by customer during shopping, from surve...

ABC: Achieving Better Control of Multimodal Embeddings using VLMs

Visual embedding models excel at zero-shot tasks like visual retrieval and classification. However, these models cannot be used for tasks that conta...

CATALYZE: a deep learning approach for cataract assessment and grading on SS-OCT images.

PURPOSE: To assess a new objective deep learning model cataract grading method based on swept-source optical coherence tomography (SS-OCT) scans provi...

AI as an intervention: improving clinical outcomes relies on a causal approach to AI development and validation.

The primary practice of healthcare artificial intelligence (AI) starts with model development, often using state-of-the-art AI, retrospectively evalua...

Seeing Eye to AI? Applying Deep-Feature-Based Similarity Metrics to Information Visualization

Judging the similarity of visualizations is crucial to various applications, such as visualization-based search and visualization recommendation sys...

Learning Vision-Based Neural Network Controllers with Semi-Probabilistic Safety Guarantees

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the ...

MIGE: A Unified Framework for Multimodal Instruction-Based Image Generation and Editing

Despite significant progress in diffusion-based image generation, subject-driven generation and instruction-based editing remain challenging. Existi...

egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks

Egocentric vision systems aim to understand the spatial surroundings and the wearer's behavior inside it, including motions, activities, and interac...

The Power of Personality: A Human Simulation Perspective to Investigate Large Language Model Agents

Large language models (LLMs) excel in both closed tasks (including problem-solving, and code generation) and open tasks (including creative writing)...

EyEar: Learning Audio Synchronized Human Gaze Trajectory Based on Physics-Informed Dynamics

Imitating how humans move their gaze in a visual scene is a vital research problem for both visual understanding and psychology, kindling crucial ap...