Ophthalmology

Increasing the Task Flexibility of Heavy-Duty Manipulators Using Visual 6D Pose Estimation of Objects

Recent advances in visual 6D pose estimation of objects using deep neural networks have enabled novel ways of vision-based control for heavy-duty robotic applications. In this study, we present a pipeline for the precise tool positioning of heavy-duty, long-reach (HDLR) manipulators using advanced machine vision. A camera is utilized in the so-called eye-in-hand configuration to estimate directl...

RetinaRegen: A Hybrid Model for Readability and Detail Restoration in Fundus Images

Fundus image quality is crucial for diagnosing eye diseases, but real-world conditions often result in blurred or unreadable images, increasing diagnostic uncertainty. To address these challenges, this study proposes RetinaRegen, a hybrid model for retinal image restoration that integrates a readability classifi-cation model, a Diffusion Model, and a Variational Autoencoder (VAE). Ex-periments o...

A Sample-Level Evaluation and Generative Framework for Model Inversion Attacks

Model Inversion (MI) attacks, which reconstruct the training dataset of neural networks, pose significant privacy concerns in machine learning. Rece...

BarkXAI: A Lightweight Post-Hoc Explainable Method for Tree Species Classification with Quantifiable Concepts

The precise identification of tree species is fundamental to forestry, conservation, and environmental monitoring. Though many studies have demonstr...

Grad-ECLIP: Gradient-based Visual and Textual Explanations for CLIP

Significant progress has been achieved on the improvement and downstream usages of the Contrastive Language-Image Pre-training (CLIP) vision-languag...

Stealthy Backdoor Attack in Self-Supervised Learning Vision Encoders for Large Vision Language Models

Self-supervised learning (SSL) vision encoders learn high-quality image representations and thus have become a vital part of developing vision modal...

To Deepfake or Not to Deepfake: Higher Education Stakeholders' Perceptions and Intentions towards Synthetic Media

Advances in deepfake technologies, which use generative artificial intelligence (GenAI) to mimic a person's likeness or voice, have led to growing i...

DeepSeek-R1 Outperforms Gemini 2.0 Pro, OpenAI o1, and o3-mini in Bilingual Complex Ophthalmology Reasoning

Purpose: To evaluate the accuracy and reasoning ability of DeepSeek-R1 and three other recently released large language models (LLMs) in bilingual c...

A graph neural network-based multispectral-view learning model for diabetic macular ischemia detection from color fundus photographs

Diabetic macular ischemia (DMI), marked by the loss of retinal capillaries in the macular area, contributes to vision impairment in patients with di...

A Novel Retinal Image Contrast Enhancement -- Fuzzy-Based Method

The vascular structure in retinal images plays a crucial role in ophthalmic diagnostics, and its accuracies are directly influenced by the quality o...

A digital eye-fixation biomarker using a deep anomaly scheme to classify Parkisonian patterns

Oculomotor alterations constitute a promising biomarker to detect and characterize Parkinson's disease (PD), even in prodromal stages. Currently, on...

Vision Language Models in Medicine

With the advent of Vision-Language Models (VLMs), medical artificial intelligence (AI) has experienced significant technological progress and paradi...

End-to-End Chart Summarization via Visual Chain-of-Thought in Vision-Language Models

Automated chart summarization is crucial for enhancing data accessibility and enabling efficient information extraction from visual data. While rece...

V-HOP: Visuo-Haptic 6D Object Pose Tracking

Humans naturally integrate vision and haptics for robust object perception during manipulation. The loss of either modality significantly degrades p...

Introducing Visual Perception Token into Multimodal Large Language Model

To utilize visual information, Multimodal Large Language Model (MLLM) relies on the perception process of its vision encoder. The completeness and a...

MegaLoc: One Retrieval to Place Them All

Retrieving images from the same location as a given query is an important component of multiple computer vision tasks, like Visual Place Recognition...

MaxGlaViT: A novel lightweight vision transformer-based approach for early diagnosis of glaucoma stages from fundus images

Glaucoma is a prevalent eye disease that progresses silently without symptoms. If not detected and treated early, it can cause permanent vision loss...

Uncovering simultaneous breakthroughs with a robust measure of disruptiveness

Progress in science and technology is punctuated by disruptive innovation and breakthroughs. Researchers have characterized these disruptions to exp...

SwimVG: Step-wise Multimodal Fusion and Adaption for Visual Grounding

Visual grounding aims to ground an image region through natural language, which heavily relies on cross-modal alignment. Most existing methods trans...

Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representations

Interpretability is crucial to enhance trust in machine learning models for medical diagnostics. However, most state-of-the-art image classifiers ba...