VisionTrim: Unified Vision Token Compression for Training-Free MLLM Acceleration

View PDF HTML (experimental)

Abstract:Multimodal large language models (MLLMs) suffer from high computational costs due to excessive visual tokens, particularly in high-resolution and video-based scenarios. Existing token reduction methods typically focus on isolated pipeline components and often neglect textual alignment, leading to performance degradation. In this paper, we propose VisionTrim, a unified framework for training-free MLLM acceleration, integrating two effective plug-and-play modules: 1) the Dominant Vision Token Selection (DVTS) module, which preserves essential visual tokens via a global-local view, and 2) the Text-Guided Vision Complement (TGVC) module, which facilitates context-aware token merging guided by textual cues. Extensive experiments across diverse image and video multimodal benchmarks demonstrate the performance superiority of our VisionTrim, advancing practical MLLM deployment in real-world applications. The code is available at: this https URL.

Comments: ICLR2026, Code Link: this https URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2601.22674 [cs.CV]

(or arXiv:2601.22674v3 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2601.22674

arXiv-issued DOI via DataCite

Submission history

From: Hanxun Yu [view email] [v1] Fri, 30 Jan 2026 07:45:48 UTC (8,833 KB) [v2] Mon, 2 Feb 2026 09:21:10 UTC (8,832 KB) [v3] Sat, 28 Mar 2026 09:00:26 UTC (8,827 KB)