arXiv Computation and Language By Falko Helm, Iryna Gurevych

Learning to Zoom Efficiently with a Contrastive Curriculum

Read the original on arXiv Computation and Language →

The paper introduces a contrastive curriculum for teaching large language models to use a zoom‑in tool without supervised fine‑tuning, leveraging an InfoNCE‑style intrinsic reward that progressively hardens negative examples. Experiments on V*, HRBench, and MME‑RealWorld demonstrate competitive performance and efficiency, with the method even surpassing baselines when replacing traditional SFT. A new synthetic dataset, Muffin&Chihuahua (M&C), is created to directly evaluate zoom‑in capability, revealing that recall best correlates with task success.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 30

Visual Parallel Search: Learning to Search High-Resolution Images with Parallel Tile Inspection and Adaptive Zoom

arXiv:2609.37002v1 Announce Type: cross Abstract: High-resolution visual question answering often fails because a multimodal model does not acquire the small, spatially localized evidence needed to a...

By Xijia Tao, Yihua Teng, Xinyu Fu, Cheng Gong, Ziru Liu, Xudong Xie, Rui Liu, Lingpeng Kong
arXiv AI
Jun 9

ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learning

arXiv:2505. 21457v2 Announce Type: replace-cross Abstract: Active vision, also known as active perception, refers to actively selecting where and how to look in order to gather task-relevant information.

By Muzhi Zhu, Hao Zhong, Canyu Zhao, Zongze Du, Mingyu Liu, Zheng Huang, Anzhou Li, Hao Chen, Cheng Zou, Jingdong Chen, Ming Yang, Chunhua Shen