Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

29,379 stories · RSS feed

arXiv Computer Vision

Oct 1

MOBA-VL: Event-Localized Multi-Turn Reinforcement Learning for Real-Time MOBA Commentary

arXiv:2609.38428v1 Announce Type: new Abstract: Real-time commentary for Multiplayer Online Battle Arena (MOBA) esports requires a vision-language model (VLM) to narrate a live match second by second...

By Shengyun Zhong, Xinkang Zhao, Ziyuan Chu, Linchao Zhu

llms reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Oct 1

Multi-LLM Collaborative Alignment via Stackelberg Games

The paper introduces Stackelberg Alignment, a leader‑follower framework that lets a pool of language models collaborate and improve by learning from each other’s responses. An EXP3 bandit leader adaptively selects instructions based on difficulty and discriminability, while the models act as followers, evaluating peers and learning via DPO or GRPO with Elo‑style reputation weighting and opponent matching. Experiments on diverse benchmarks show that this adaptive curriculum outperforms static baselines by up to 12‑25% and improves multi‑LLM evolution.

By Christina Hahn, Shangbin Feng, Dean Light, Swastik Roy, Hila Gonen, Yulia Tsvetkov

llms reinforcement-learning benchmarks safety

arXiv Computer Vision

Oct 1

From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning

arXiv:2609.38924v1 Announce Type: new Abstract: Major adverse cardiovascular events (MACE) remain the leading cause of mortality worldwide. Opportunistic screening using routinely acquired clinical d...

By Jialu Pi, Yanan Ma, Weijie Chen, Owen Crystal, Shubham Trivedi, Stephen Xie, Anna Silverman, Matthew Stib, Chadi Ayoub, Reza Arsanjani, Imon Banerjee

llms reinforcement-learning efficiency multimodal benchmarks

arXiv Computer Vision

Oct 1

MEMO: Multi-Level Entity-Aware Memory for Streaming Video Understanding

arXiv:2609.38900v1 Announce Type: new Abstract: Streaming video understanding requires models to process unbounded visual streams while preserving rich visual semantics across vast temporal horizons,...

By Yinying Li, Yuqian Fu, Yulin Dai, Jingyu Gong, Tianwen Qian, Xiaoling Wang

llms multimodal benchmarks

arXiv Computer Vision

Oct 1

PARK: Accurate Block Retrieval for Sparse Attention in Video Diffusion Transformers

arXiv:2609.38978v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) have become a dominant architecture for video generation, but their efficiency is limited by the quadratic complexity of...

By Yun Dai, Jiarui Wen, Huiping Zhuang, Cen Chen, Ziqian Zeng

llms diffusion

arXiv Computer Vision

Oct 1

Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection

arXiv:2609.39066v1 Announce Type: new Abstract: Conventional image forgery detection methods produce binary scores or pixel-level masks without interpretable evidence, while recent multimodal large l...

By Zhiya Tan, Jing Huang, Changtao Miao, Lin Tan, Xin Zhang, Weiwei Feng, Jianshu Li, Joey Tianyi Zhou

llms agents reinforcement-learning fine-tuning multimodal benchmarks

arXiv Computer Vision

Oct 1

Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models

arXiv:2609.39134v1 Announce Type: new Abstract: Visual-token compression improves the efficiency of large vision-language models, but can expose failures that full-token evaluation misses. We study a...

By Shilinlu Yan, Bowen Chen, Yuechen Zhang, Zhenhong Zhou, Li Sun, Sen Su

llms multimodal safety

arXiv Computer Vision

Oct 1

Asking the World: Generalist Physical Reasoning through Agentic World Modeling and Probing

arXiv:2609.39135v1 Announce Type: new Abstract: Physical reasoning from video requires inferring latent physical properties and dynamics beyond direct observation. Direct VLM inference remains unreli...

By Shenxiang Zeng, Chen Yang, Peiyao Chen, Guohui Zhang, Jiansheng Fan, Chen Wang

llms agents multimodal

arXiv Computer Vision

Oct 1

When Can Text Replace Vision? Structural Bottlenecks in Diagram Reasoning

arXiv:2609.39142v1 Announce Type: new Abstract: Can structured text replace vision for diagram reasoning? A wrong answer after textualization can arise because the representation omits information th...

By Yunbei Zhang, Janet Wang, Jihun Hamm, Chandan K Reddy

llms multimodal

arXiv Computer Vision

Oct 1

Uruqi: Learning Spatial Cognition from Visual Experience

arXiv:2609.39195v1 Announce Type: new Abstract: Spatial intelligence requires maintaining a coherent understanding of the world as the embodied agent moves. Like humans, the agent must use its own mo...

By Shichao Li, Meiqi Wang, Fei Su, Zhicheng Zhao

llms agents robotics multimodal benchmarks

arXiv Computer Vision

Oct 1

Comparative study of adapting pre-trained models for driving behavior video captioning

arXiv:2609.39542v1 Announce Type: new Abstract: This report examines and compares some of the many fine tuning and prompting methods existing, applying them within the domain of autonomous driving. T...

By Sayak Mallick, Philipp Geiger, Augustin Kelava

llms agents robotics fine-tuning

arXiv Computer Vision

Oct 1

From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning

arXiv:2609.39566v1 Announce Type: new Abstract: Foundation models can serve as clinical agents through tool-use harnesses. However, conventional medical benchmarks assess reasoning over preselected e...

By Minye Shao, Chaohui Yu, Yixuan Wu, Fan Wang, Ling Shao, Yang Long

llms agents reinforcement-learning fine-tuning efficiency multimodal benchmarks

arXiv Computer Vision

Oct 1

SAGE: Salient Factor Discovery and Generation with Visual Foundation Representations

arXiv:2609.39635v1 Announce Type: new Abstract: Given a target dataset, such as faces with eyeglasses, and a background dataset, such as faces without, contrastive analysis separates \textit{salient}...

By Shuang Liang, Lejun Liao, Shiyuan Zhang, Max C. Zhang, Xiaolong Luo, Han Wang, Stefano Anzellotti, Yuan Yuan

llms diffusion

arXiv Computer Vision

Oct 1

Typographic Attack Against VLM-based AI-generated Image Detection

arXiv:2609.39662v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used for AI-generated image (AIGI) detection, providing natural-language explanations for authenticity j...

By Eunmin Lee, Jungwoo Kim, Jong-Seok Lee

llms multimodal

arXiv Computer Vision

Oct 1

Image Classifiers are Efficient Self-Supervised Video Representation Learners

arXiv:2609.40347v1 Announce Type: new Abstract: We introduce VideoMSN, a Masked Siamese Network framework for efficient self-supervised spatio-temporal representation learning in videos. Instead of r...

By Owais Iqbal, Sudipta Sarkar, Shyam Marjit, Omprakash Chakraborty, Anirban Chakraborty, Abir Das

llms rag computer-vision benchmarks

arXiv Computer Vision

Oct 1

Semantic Misalignment in Vision-Language Models under Perceptual Degradation

arXiv:2601.08355v3 Announce Type: replace Abstract: Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for sa...

By Guo Cheng, Huang Li

llms agents computer-vision robotics multimodal benchmarks safety

arXiv Computer Vision

Oct 1

EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detection

arXiv:2603.17343v3 Announce Type: replace Abstract: The rapid proliferation of AI-Generated Images (AIGIs) poses severe misinformation risks, making AIGI detection critical yet challenging. Tradition...

By Chenyang Zhu, Maorong Wang, Jun Liu, Ching-Chun Chang, Isao Echizen

llms agents reinforcement-learning multimodal benchmarks safety

arXiv Computer Vision

Oct 1

Project and Mix: Task-Semantic Prototypes for Few-Shot Image Classification

arXiv:2603.24528v2 Announce Type: replace Abstract: Vision-language models like CLIP are trained with the objective of aligning text and image pairs. Beyond text prompts alone, recent works show that...

By Dipam Goswami, Simone Magistri, Gido M. van de Ven, Bart{\l}omiej Twardowski, Andrew D. Bagdanov, Tinne Tuytelaars, Joost van de Weijer

llms rag computer-vision multimodal benchmarks safety

arXiv Computer Vision

Oct 1

XEmbodied: A Foundation Model with Enhanced Geometric and Physical Cues for Large-Scale Embodied Environments

arXiv:2604.18484v2 Announce Type: replace Abstract: Vision-Language-Action (VLA) models drive next-generation autonomous systems, but training them requires scalable, high-quality annotations from co...

By Kangan Qian, ChuChu Xie, Yang Zhong, Jingrui Pang, Siwen Jiao, Sicong Jiang, Zilin Huang, Yunlong Wang, Kun Jiang, Mengmeng Yang, Hao Ye, Guanghao Zhang, Hangjun Ye, Guang Chen, Long Chen, Diange Yang

llms agents reinforcement-learning robotics multimodal benchmarks

arXiv Computer Vision

Oct 1

One Adapter, Every Resolution: Gated Low-Rank Adaptation for Remote Sensing VLMs

arXiv:2605.07562v2 Announce Type: replace Abstract: Remote sensing imagery spans ground sampling distances (GSDs) from centimeters to tens of meters, so both the visual evidence for a geographic conc...

By Song Zhang, Yanlong Chen, Yining Chen, Xiaowei Zhang, Yawei Li

llms fine-tuning multimodal

Get the daily briefing