arXiv Computation and Language

Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agents

The paper introduces a visual-native agent harness that registers every tool‑returned image as an addressable reference, enabling reuse of intermediate visual evidence in multimodal deep search tasks. It also proposes On‑Policy Data Evolution (ODE), a closed‑loop data generator that refines training data across rounds based on policy rollouts, targeting the agent’s evolving needs. Experiments on eight benchmarks show ODE boosts the Qwen3‑VL‑8B agent’s performance from 24.9% to 39.0% on average, and from 30.6% to 41.5% at 30B, while validating the benefits of image bank reuse and rollout‑feedback evolution.

arXiv AI
Sep 1

WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents

WeAgent-MMSearch introduces a multimodal search agent that preserves retrieved images as persistent references, enabling the model to inspect, process, and cite them throughout a search trajectory. The system includes a harness (WeAgent-Harness), a post‑training method (FA‑GSPO) that recovers salvageable rollouts, and a new benchmark (VisTarget‑Bench) to evaluate image‑retrieval versus visual‑perception failures. Evaluation shows that agentic post‑training boosts performance by 19.22 points, allowing the model to outperform similarly sized open‑source models and compete with much larger ones.

By Zongkai Liu, Hui Zhang, Liqiang Niu, Zhen Cao, Han Li, Juntao Liu, Wenchao Chen, Chengduo Zhao, Chao Yu, Fandong Meng
arXiv Computer Vision
Sep 7

WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing

WeAgent-MMGenEdit is a comprehensive framework for multimodal agentic image generation and editing that addresses the unreliability of current models when prompts require external world knowledge. It introduces a multimodal harness with persistent evidence management, a scalable data construction pipeline producing 23K supervised trajectories and 14.7K RL tasks, and a bilingual benchmark (WeBench-MMGenEdit) for knowledge-intensive generation and multi-image editing. Post‑training methods based on SFT and RL further refine the agent policy and image backend, enabling a 30B‑parameter policy to outperform similarly sized models and approach the performance of a 1T‑parameter agent.

By Hui Zhang, Zongkai Liu, Liqiang Niu, Juntao Liu, Han Li, Zhen Cao, Wenchao Chen, Chengduo Zhao, Fandong Meng
arXiv AI
Aug 5

Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent

arXiv:2608. 03979v1 Announce Type: cross Abstract: We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration.

By Zhen Fang, Yu Zeng, Wenxuan Huang, Yiming Zhao, Shiting Huang, Tianfei Ren, Qi Lu, Qingnan Ren, Qisheng Su, Lionel Z. Wang, Qingyu Yin, Shuang Chen, Zehui Chen, Lin Chen, Zhenfei Yin, Yao Hu, Shaohui Lin, Wanli Ouyang, Shaosheng Cao, Feng Zhao
arXiv AI
Oct 1

EviRover: Reinforcing Agentic Perception Beyond a Glance

EviRover is a perception agent that goes beyond a single glance by actively gathering information to resolve perceptual queries. The authors created two data generation pipelines, producing EviRover-SFT-5K and EviRover-RL-12K, and a human‑verified benchmark called EviLens with 688 instances across five perception categories. Trained with supervised fine‑tuning and agentic reinforcement learning, the 4B EviRover outperforms its backbone by an average of 30 points on EviLens and shows strong transfer to other benchmarks such as WebEyes and BrowseComp‑VL.

By Kaixuan Fan, Kaituo Feng, Tianshuo Peng, Yilei Jiang, Manyuan Zhang, Junke Wang, Xiangyu Yue
arXiv Computer Vision
Oct 9

OneSearch-VL: Unified Multimodal Deep Research Agent for Image and Video

OneSearch‑VL is a unified multimodal deep research agent that handles single‑image, multi‑image, and video tasks by leveraging a Visually Grounded Evidence Graph (VGEG) to encode dependencies among visual anchors, entity relations, facts, and answer‑producing operations. The VGEG‑based data engine builds and verifies questions, filters expert trajectories, and supports supervised fine‑tuning (SFT) and reinforcement learning (RL) with the Evidence‑aware Visual‑Grounded Rubric reward (EVGR). Experiments demonstrate that OneSearch‑VL‑8B outperforms Qwen3‑VL‑8B with tool access by 20.2 and 17.6 percentage points on new multimodal benchmarks, while also achieving significant gains across seven image benchmarks and VideoDR.

By Hongyu Li, Manyuan Zhang, Kaituo Feng, Shu Chen, Dian Zheng, Hao Li, Hao Yu, Zhangquan Chen, Zoey Guo, Ray Zhang, Shaofei Huang, Tianrui Hui, Linjiang Huang, Si Liu
arXiv AI
Jun 16

Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning

arXiv:2606. 15231v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have demonstrated impressive capabilities in many visual tasks, but they often struggle with factual grounding when confronted with complex, open-world scenarios.

By Zhengbo Zhang, Changtao Miao, Jinbo Su, Zhaowen Zhou, Chunxia Zhang, Xukai Wang, Ruiqi Liu, Kaiyuan Zheng, Jiansheng Cai, Bo Zhang, Zhe Li, Shiming Xiang, Ying Yan
arXiv Computer Vision
4d ago

VEvo-Harness: Causally-Guarded Self-Evolving Harness for Agentic Image Generation

VEvo-Harness is a causally-guarded, continual self‑evolving system designed to improve agentic image generation. It introduces a visual traceback mechanism, visual continual governance, a lifecycle‑managed harness state, and a heterogeneous sandbox policy to ensure only causally valid skill updates are incorporated. The system outperforms existing agentic methods and rivals proprietary generators while preserving continual evolution and generalization.

By Yuan Wang, Yuhang Yu, Mengting Chen, Tianrun Xu, Zihao Pan, Xuetao Feng, Wei Li
arXiv AI
Oct 1

Learning to Route in Visual Space via Multi-Step Embedding Retrieval

The paper introduces VHOP, a data generation framework and benchmark for visual agentic search, and VHOP-Router, an end‑to‑end training pipeline that turns a standard embedding model into an autoregressive multi‑step retriever operating directly in visual latent space. VHOP-Router eliminates the need for intermediate text queries, boosting retrieval accuracy from under 5% to 76.3% and improving task success rates by 52.7% while dramatically reducing token usage and API payloads. The approach generalizes to unseen difficulty levels and realistic test sets, offering an efficient solution that preserves native LLM capabilities.

By Tianyu Chen, Mingyuan Zhou, Jiaxing Wu