arXiv AI
Self-Evolving Visual Agent via Margin Reward
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
Sep 30
Beacon: Knowing When and How to Perform Agentic Visual Reasoning
Beacon is a new agentic visual reasoning model that improves multimodal large language models (MLLMs) by better deciding when to use tools and how to use them. It introduces two key concepts—Mode Adaptiveness, which ensures tools are invoked only when necessary, and Tool Effect, which measures the net benefit of tool use— and trains the model with supervised fine‑tuning and reinforcement learning that rewards necessity-aware decisions and expands capability through expert hints. Across 13 benchmarks, Beacon outperforms other open‑source models, achieving the highest average score and the largest net tool‑gain on diagnostic tests.
arXiv AI
Sep 10
Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning
arXiv:2609.08025v1 Announce Type: new Abstract: Reasoning agents increasingly rely on external tools such as web search to answer complex queries. Reinforcement learning (RL) finetuning algorithms su...
arXiv AI
Oct 9
VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoning
VICO proposes a co‑evolutionary framework where a vision‑language model (actor) and an Environment‑as‑Rewriter (EnvRewriter) are trained together. The EnvRewriter edits visual structures—such as scene graphs, chart tables, or protected region masks—to generate new training samples whose difficulty is calibrated to the actor’s current performance via a pass‑rate reward. Across nine multimodal benchmarks, VICO‑8B outperforms its base model by up to +5.0 % on out‑of‑domain tasks and surpasses other co‑evolution baselines while requiring far fewer labeled samples.
arXiv AI
Jun 29
ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering
arXiv:2606. 27974v1 Announce Type: cross Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires models to combine image understanding with external knowledge.
arXiv AI
Aug 3
Multimodal Reinforcement Learning with Adaptive Verifier for AI Agents
arXiv:2512. 03438v3 Announce Type: replace Abstract: Agentic reasoning models trained with multimodal reinforcement learning (MMRL) have become increasingly capable, yet they are almost universally optimized using sparse, outcome-based rewards computed based on the final answers.
arXiv Machine Learning
Sep 23
Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
Agent0 is a fully autonomous framework that enables large language model agents to evolve without external data by using a multi‑step co‑evolution process. It pits a curriculum agent against an executor agent, both derived from the same base LLM, where the curriculum agent creates increasingly challenging tasks and the executor learns to solve them. By integrating external tools into the executor’s workflow, the system creates a self‑reinforcing cycle that continuously generates high‑quality curricula, leading to significant gains in reasoning performance—an 18% improvement on mathematical reasoning and 24% on general reasoning for the Qwen3‑8B‑Base model.