arXiv Computer Vision By Ziqian Wang, Yuxiao Cheng, Tingxiong Xiao, Jinli Suo

ExBind: A Controlled Diagnostic Benchmark for Visual-to-Executable Correspondence

Read the original on arXiv Computer Vision →

ExBind is a controlled diagnostic benchmark that isolates the visual‑to‑executable correspondence layer in multimodal coding and editing systems. It generates 250 broad and 240 targeted cases across SVG, DOM, canvas, tree, graph, and table formats, each with deterministic mappings to executable references. Models are evaluated solely on their ability to output the correct reference, with structural constraints scored without requiring reasoning traces.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jul 1

An Executable Benchmarking Suite for Tool-Using Agents

arXiv:2605. 11030v2 Announce Type: replace-cross Abstract: Closed-loop tool-using agents are increasingly evaluated in executable web, code, and micro-task environments, but benchmark reports often conflate workloads, action-generating drivers, and the evidence admitted for systems-facing claims.

By Zhiqing Zhong, Zhijing Ye, Jiamin Wang, Xiaodong Yu