See What I Mean: Aligning Vision and Language Representations for Video Fine-grained Object Understanding

by [unverified] · free · Last verified 2026-06-21T03:07:51.999Z

We present SWIM (See What I Mean), a novel training strategy that aligns vision and language representations to enable fine-grained object understanding solely from textual prompts. Unlike existing approaches that require explicit visual prompts, such as masks or points, SWIM leverages mask super...