arXiv AI By Mohammad Talebi-Kalaleh, Qipei Mei

Structural Plan-to-Model Conversion with Deterministic Geometry and Guarded Agentic Vision-Language Refinement

Read the original on arXiv AI →

The paper introduces a novel framework that converts structural framing plans from PDF drawings into editable finite‑element model drafts without requiring task‑specific detector training. It combines a deterministic geometry extraction stage—estimating scale, recognizing five entity classes, and assembling a drafting grammar—with an agentic vision‑language refinement stage that proposes corrections, performs admission tests, and ensures fail‑closed transactions. Evaluation on a 100‑plan benchmark shows high accuracy, with scale within 0.1% and recall/precision values above 0.86 for all component types.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Aug 27

Training-Free Agentic Computer Vision for Structural Component Detection in 2D Structural Framing Plans

The paper presents a training‑free, agentic computer‑vision system that converts 2D structural framing plan PDFs into editable finite‑element model drafts. It uses a deterministic stage to extract geometric primitives, estimate scale, and recognize five entity classes via a drafting grammar, followed by an agentic stage that applies typed corrections and fail‑closed transactions. Evaluation on a 100‑plan benchmark shows high precision and recall across columns, beams, walls, braces, and openings, with scale estimates within 0.1% of reference.

By Mohammad Talebi-Kalaleh, Qipei Mei
arXiv Computer Vision
Sep 25

AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing

AgenticCADedit introduces a stateful, tool‑mediated approach to multimodal 3D CAD editing, transforming the process from generating a single complete program to executing a sequence of incremental, verifiable actions on a persistent CAD state. By committing each step, inspecting geometry, and selectively reverting faulty operations, the method preserves partial progress and builds upon earlier edits. Experiments across three large language models show substantial gains in validity and acceptance, with the weakest baseline model’s validity rising from 51.0% to 94.8% and a token‑cost reduction of 66.7% compared to neuralCAD‑Edit.

By Saptarshi Neil Sinha, Mika Silvan Goschke, Paul Julius K\"uhn, Arjan Kuijper, Michael Weinmann
arXiv Computation and Language
Aug 25

The Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generation

The paper investigates why reasoning‑augmented text‑to‑image models like GoT‑R1 sometimes fail on compositional prompts. By separating the explicit textual plan from the decoder, the authors show that the decoder faithfully executes the plan while the planner often writes incorrect spatial relations, especially for phrasing‑dependent cues. Editing or replacing the plan improves image quality without retraining, demonstrating the viability of modular planner‑decoder architectures.

By Ashritha Gonuguntla
arXiv AI
Sep 10

BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprints

BlueprintAgent (BPA) is a multimodal agent that converts scanned reinforced‑concrete building blueprints into simulation‑ready frame models by treating a large language model (MLLM) as the primary reader and decision maker, while OCR and computer vision provide localized evidence. BPA implements engineering constraints as callable validators that trigger targeted MLLM revisits over specific regions, enabling precise beam‑column support, span count, and 3D continuity checks. In evaluations on 300 real scanned sheets from 20 projects, BPA achieved a macro‑averaged Beam F1 of 0.994, vastly outperforming single‑MLLM zero‑shot (0.301) and fixed‑pipeline (0.820) baselines.

By Zhouyuan Xu, Chen Yang, Linhao Wang, Jiansheng Fan, Chen Wang