Hugging Face Trending Papers July 7, 2026

Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning

Read the original on Hugging Face Trending Papers →

Recent advancements in Multimodal Large Language Models (MLLMs) have evolved from static perception to interleaved visual-language reasoning, often referred to as ``thinking with images''. A basic operation in this reasoning process is to zoom in on regions of interest (often represented with bounding boxes) to acquire finer visual details.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

arXiv AI

Jul 8

Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning

arXiv:2607. 05798v1 Announce Type: cross Abstract: Recent advancements in Multimodal Large Language Models (MLLMs) have evolved from static perception to interleaved visual-language reasoning, often referred to as ``thinking with images''.

By Yake Wei, Yuan Wang, Fengyun Rao, Jing Lyu, Di Hu

llms rag computer-vision multimodal benchmarks safety

arXiv AI

Jun 2

CLIP Tricks You: Training-free Token Pruning for Efficient Pixel Grounding in Large VIsion-Language Models

arXiv:2605. 13178v2 Announce Type: replace-cross Abstract: In large vision-language models, visual tokens typically constitute the majority of input tokens, leading to substantial computational overhead.

By Sangin Lee, Yukyung Choi

llms fine-tuning efficiency multimodal

arXiv AI

Aug 6

When Prompts Become Pixels: Prompt-Region Grounding for Multimodal Reasoning

arXiv:2608. 04726v1 Announce Type: new Abstract: Multimodal large language models increasingly reason over screenshots and documents where the task itself may be written in pixels.

By Yongxin Wang, Ruizhe Zhou, Yueling Tang, Yingying Zhu, Xuemin Zhao, Xiaojun Chang, Xiaodan Liang

llms computer-vision multimodal benchmarks

arXiv AI

Jun 16

Thinking with Visual Grounding

arXiv:2606. 16122v1 Announce Type: new Abstract: Visual thinking should not only sound right; it should show its evidence.

By Junkai Zhang, Yihe Deng, Kai-Wei Chang, Wei Wang

llms agents reinforcement-learning multimodal benchmarks

arXiv AI

Aug 11

MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentation

arXiv:2608. 09818v1 Announce Type: cross Abstract: Reliable medical image understanding requires models to connect clinical language and visual reasoning with pixel-level grounding.

By Haoyu Yang, Meixing Shi, Zengjie Chen, Haoran Sun, Haitao Leng, Xiaoming Shi, Yuxiang Cai, Yankai Jiang

llms computer-vision fine-tuning multimodal benchmarks

arXiv AI

Jul 14

Evidence-Backed Video Question Answering

arXiv:2607. 11862v1 Announce Type: cross Abstract: Current Video Large Language Models (Video LLMs) excel in question answering (QA) but largely operate as black boxes, providing textual answers without verifiable visual grounding.

By Shijie Wang, Honglu Zhou, Ziyang Wang, Ran Xu, Caiming Xiong, Silvio Savarese, Chen Sun, Juan Carlos Niebles

llms computer-vision nlp fine-tuning benchmarks

Related stories

Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning

CLIP Tricks You: Training-free Token Pruning for Efficient Pixel Grounding in Large VIsion-Language Models

When Prompts Become Pixels: Prompt-Region Grounding for Multimodal Reasoning

Thinking with Visual Grounding

MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentation

Evidence-Backed Video Question Answering