arXiv:2610.14403v2 Announce Type: replace Abstract: Learning reusable skills can improve visual reasoning agents, yet applying a skill still requires the agent to implement or invoke a procedure and...
VETR (Verified Execution Trajectories for Refinement) is a framework that enables visual agents to recursively improve symbolic graphics reasoning by extracting actionable evidence from execution traces. It retains aligned program/render records and uses an execution refiner to compile observed writes and state changes into constrained alternative programs, which are then validated against captured runtime state. Evaluations on BlenderGym and BlenderBench with GPT‑5.6‑luna and Qwen3.8‑27B demonstrate that VETR consistently outperforms existing refinement strategies such as BlenderAlchemy and VIGA.
arXiv:2609.24362v1 Announce Type: new Abstract: Sandboxed computer environments support multi-step reasoning with tools, executable programs, and persistent files, yet their extension from language m...
arXiv:2606. 16496v1 Announce Type: cross Abstract: Large multimodal language models (LLMs) have emerged as powerful tools for guiding evolutionary search toward interpretable programmatic policies.
arXiv:2609.22327v1 Announce Type: cross Abstract: Visual graph reasoning requires answering graph-theoretic questions directly from graph images, where graph topology and state are conveyed visually...
The paper surveys Multimodal Code Intelligence, focusing on tasks where code is generated, edited, refined, or reasoned about under visually grounded inputs such as screenshots, charts, and videos. It categorizes the field by the role of code—rendered artifact, editable structure, intermediate reasoning trace, or executable tool interface—and organizes benchmarks into four domains: Graphical User Interface, Scientific Visualization, Structured Graphics, and Frontier Tasks and Frameworks. The authors argue that reliable evaluation must include evidence of semantics and interaction beyond visual fidelity, and propose four verification-centered research directions to advance the field toward evidence-grounded executable systems.
arXiv:2512. 11995v2 Announce Type: replace-cross Abstract: While many vision-language models (VLMs) are developed to answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually require multiple rounds of exploration and reasoning in the visual space.
OmniHarness is a framework that enables generalizable visual generation by learning symbolic policies from verified executions. It abstracts shared procedures and applicability conditions, allowing these policies to be instantiated, adapted, and composed for new tasks while keeping model parameters fixed. The system uses intermediate verification for refinement, self-directed inquiry to generate practice tasks, and continuous feedback to expand capabilities, achieving strong results on multiple benchmarks and outperforming baselines on Creative tasks.
arXiv:2608.22174v1 Announce Type: new Abstract: Unified multimodal models (UMMs) can perform both understanding and generation, raising a central question: can visual generation improve understanding...
arXiv:2606. 15693v1 Announce Type: cross Abstract: LLMs have significantly advanced code generation, enabling the synthesis of functional programs.
arXiv:2606. 10334v1 Announce Type: new Abstract: Code-generating large language models (LLMs) increasingly produce visual artifacts such as charts, web pages, and slides by writing programs that are executed by non-differentiable renderers, committing to code before observing the render.
VisualSphinx is a large-scale synthetic dataset designed to train vision language models (VLMs) on visual logical reasoning tasks. The dataset is generated through a rule-to-image synthesis pipeline that expands puzzle rules from seed questions and produces executable rendering programs for puzzle assembly. Experiments using standard GRPO with binary correctness rewards show that VLMs trained on VisualSphinx achieve improved logical coherence and performance on logical reasoning, as well as on related tasks such as algebraic, arithmetic, and geometry reasoning.