The paper introduces 2D‑FET‑Bench V2, a benchmark of 128 field‑effect transistor layout tasks derived from real microscopy‑derived flake contours, including complex shapes and multi‑flake scenarios. Each task provides a textual device specification and contour coordinates; agents generate GDSII operations that are verified for geometric, structural, and contour‑integrity compliance. Six models and seven GPT‑based workflow variants were evaluated, with GPT‑5.6‑Luna using ReAct‑3 achieving the highest performance, passing 62.3 % of attempts and solving 80.5 % of tasks at least once.
arXiv:2605. 07066v3 Announce Type: replace Abstract: Autonomous systems that build structures from natural-language instructions need reliable spatial reasoning, yet large language models (LLMs) make systematic coordinate errors when generating three-dimensional block placements.
SpaceAct is a new benchmark that tests multimodal large language models on 3D spatial and temporal reasoning through closed‑loop physical action and active perception. It uses interlocking bricks and mechanical puzzles to create 108 verified instances across 36 task families, requiring models to reconstruct 3D geometry, anticipate dynamics, and execute precise 6‑DoF poses while avoiding collisions. The accompanying SAPA framework provides diagnostic modes and active‑perception capabilities, revealing that even with a valid plan, current models struggle with 3D visual grounding and action refinement.
VETR (Verified Execution Trajectories for Refinement) is a framework that enables visual agents to recursively improve symbolic graphics reasoning by extracting actionable evidence from execution traces. It retains aligned program/render records and uses an execution refiner to compile observed writes and state changes into constrained alternative programs, which are then validated against captured runtime state. Evaluations on BlenderGym and BlenderBench with GPT‑5.6‑luna and Qwen3.8‑27B demonstrate that VETR consistently outperforms existing refinement strategies such as BlenderAlchemy and VIGA.
arXiv:2609.33399v2 Announce Type: replace Abstract: In realistic education, a solution is often expressed not only in words but in a drawing--a circuit, a geometric construction, a function plot--and...
The paper introduces PEPS, a training‑free framework that improves spatial reasoning in Vision‑Language Models by parsing queries into a compact set of executable requirements before execution. PEPS uses a typed FESM schema (Frame, Entity, State, Metric) to commit queries, then selectively grounds primitives via fixed geometric APIs and verifies sufficiency, allowing early termination or targeted repair. Experiments on spatial reasoning benchmarks show that PEPS boosts accuracy while reducing refinement rounds, API cost, and latency compared to existing tool‑integrated baselines.
arXiv:2609.16251v1 Announce Type: new Abstract: Computer-use agents are increasingly evaluated in realistic desktop environments, but existing benchmarks provide limited coverage of professional engi...
Code4Scene is a benchmark that evaluates coding agents on constructing and editing 3D scenes in Unreal Engine. It tests agents on two tasks: construction, where they must build a scene from open‑ended language, and editing, where they must recover a target scene from reference images while preserving everything else. The benchmark measures task fulfillment, artifact integrity, and physical validity, revealing that construction and editing performance are correlated but not interchangeable, with agents struggling most with spatial composition and precise edits.
arXiv:2609.21263v1 Announce Type: new Abstract: Automated macro placement remains a fundamental challenge in VLSI physical design. Despite decades of research, existing approaches predominantly optim...
arXiv:2606. 17321v1 Announce Type: new Abstract: Training computer-use agents (CUAs) -- models that interact with graphical desktops through screenshots and keyboard/mouse actions -- requires large-scale, diverse trajectory data collected in full desktop environments.
The paper reports on training and calibration experiments for three open models on the ARC‑AGI‑2 benchmark, using offline runs on four L4 GPUs for up to 12 hours. For the NVARC Qwen3‑4B grid model, a curated corpus of 12,000 executable rules and 95,993 tasks was built, and fine‑tuning on 1,920 real task records raised the semi‑private score from 28.96 to 33.06, with no synthetic‑task checkpoint outperforming the real‑task model. For the Qwen3.8‑27B reasoning model, fine‑tuning on 1,036 of its own reasoning traces and a specialized inference procedure increased the score from 26.81 to 44.03, while the Qwen3.8‑Flash‑Next mixture‑of‑experts model achieved a best score of 56.67 after expert pruning, routing statistics adaptation, and an FP8 indexer cache.
AgenticCADedit introduces a stateful, tool‑mediated approach to multimodal 3D CAD editing, transforming the process from generating a single complete program to executing a sequence of incremental, verifiable actions on a persistent CAD state. By committing each step, inspecting geometry, and selectively reverting faulty operations, the method preserves partial progress and builds upon earlier edits. Experiments across three large language models show substantial gains in validity and acceptance, with the weakest baseline model’s validity rising from 51.0% to 94.8% and a token‑cost reduction of 66.7% compared to neuralCAD‑Edit.
Computer-use agents are increasingly evaluated in realistic desktop environments, but existing benchmarks provide limited coverage of professional engineering workflows whose outputs are persistent, s...