Visual Large Language Models for Generalized and Specialized Applications
Journal:
arXiv
Published Date:
Jan 6, 2025
Abstract
Visual-language models (VLM) have emerged as a powerful tool for learning a
unified embedding space for vision and language. Inspired by large language
models, which have demonstrated strong reasoning and multi-task capabilities,
visual large language models (VLLMs) are gaining increasing attention for
building general-purpose VLMs. Despite the significant progress made in VLLMs,
the related literature remains limited, particularly from a comprehensive
application perspective, encompassing generalized and specialized applications
across vision (image, video, depth), action, and language modalities. In this
survey, we focus on the diverse applications of VLLMs, examining their using
scenarios, identifying ethics consideration and challenges, and discussing
future directions for their development. By synthesizing these contents, we aim
to provide a comprehensive guide that will pave the way for future innovations
and broader applications of VLLMs. The paper list repository is available:
https://github.com/JackYFL/awesome-VLLMs.
