arXiv Computer Vision

Training-Free Agentic Computer Vision for Structural Component Detection in 2D Structural Framing Plans

The paper presents a training‑free, agentic computer‑vision system that converts 2D structural framing plan PDFs into editable finite‑element model drafts. It uses a deterministic stage to extract geometric primitives, estimate scale, and recognize five entity classes via a drafting grammar, followed by an agentic stage that applies typed corrections and fail‑closed transactions. Evaluation on a 100‑plan benchmark shows high precision and recall across columns, beams, walls, braces, and openings, with scale estimates within 0.1% of reference.

arXiv AI
Aug 19

Structural Plan-to-Model Conversion with Deterministic Geometry and Guarded Agentic Vision-Language Refinement

The paper introduces a novel framework that converts structural framing plans from PDF drawings into editable finite‑element model drafts without requiring task‑specific detector training. It combines a deterministic geometry extraction stage—estimating scale, recognizing five entity classes, and assembling a drafting grammar—with an agentic vision‑language refinement stage that proposes corrections, performs admission tests, and ensures fail‑closed transactions. Evaluation on a 100‑plan benchmark shows high accuracy, with scale within 0.1% and recall/precision values above 0.86 for all component types.

By Mohammad Talebi-Kalaleh, Qipei Mei
arXiv Computation and Language
Aug 25

The Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generation

The paper investigates why reasoning‑augmented text‑to‑image models like GoT‑R1 sometimes fail on compositional prompts. By separating the explicit textual plan from the decoder, the authors show that the decoder faithfully executes the plan while the planner often writes incorrect spatial relations, especially for phrasing‑dependent cues. Editing or replacing the plan improves image quality without retraining, demonstrating the viability of modular planner‑decoder architectures.

By Ashritha Gonuguntla
Hugging Face Trending Papers
Aug 3

Long-Horizon Autonomous Architecture Research with a Language-Model Agent: A Behavioural Case Study

We study what happens when a single general-purpose large language model acts as the sole researcher on a long-horizon neural architecture design problem. The agent receives a scientific question, an initial hypothesis and motivation, a compute budget, and research affordances (source and experiment management, experiment tracking, literature access, and persistent memory), then autonomously proposes, implements, evaluates, and records experiments over an extended period.

arXiv AI
Jul 29

CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model

arXiv:2607. 25487v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models translate natural-language commands into robot action sequences, but leading systems on the LIBERO-Plus robustness benchmark use three- to seven-billion-parameter backbones whose memory demands can exceed embedded robotic budgets.

By Minhyeok Lee, Chiyoung Kim, Chanhoe Gu, Seongrok Kim, Sanghyuk Roy Choi, Donghwan Hwang, Donghun Ryu, Seokhyun Kim
arXiv Computation and Language
Aug 27

Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models

In 2026, the SHROOM-Visions shared task was launched at the UncertaiNLP Workshop co‑located with EMNLP to address hallucinations in large vision‑language models. The task builds on the SHEEP dataset and asks participants to detect and classify fine‑grained hallucination spans in image‑conditioned text generation across four languages (Chinese, English, French, Italian) using a five‑class taxonomy. The competition attracted 27 teams and over 600 system submissions, with top systems achieving character‑level, label‑conditioned, and IoU scores of 0.58, 0.46, and 0.51 respectively, surpassing baselines by 30‑40 points.

By Ra\'ul V\'azquez, Aman Sinha, Chuyuan Li, Claudio Savelli, Eduardo Cal\`o, Emilio Raimond, Stella Frank, Hengyu Luo, Flavio Giobergia, Vincent Segonne, Lorenzo Vaiani, J\"org Tiedemann, Timothee Mickus
arXiv Computation and Language
Aug 27

PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans

PlanSightRAG is a visual-first multimodal retrieval‑augmented generation system designed to automate question answering and compliance checking of civil standard plans. It processes plan imagery directly, using a ColNomic‑3B multi‑vector retrieval engine, an agentic Planner‑Retriever‑Auditor‑Synthesizer, and MaxSim heatmaps to provide an evidence trail. The system achieves high recall on a new 4,056‑pair benchmark from five state DOTs, and demonstrates near‑perfect verdict accuracy on synthetic compliance drawings when a rule threshold is supplied, outperforming OCR‑based baselines.

By Nabaraj Subedi, Shuvo Dip Datta, Ahmed Abdelaty, Shivanand Venkanna Sheshappanavar
arXiv AI
6d ago

Making Every Tool Call Count: Necessary Tool-Evidence Path Rewards for Agentic Vision-Language Models

The paper introduces the Necessary Tool‑Evidence Path (NTEP) annotation scheme and its associated reward mechanism (NTEP‑R) to better supervise vision‑language models that use external tools. By explicitly specifying which evidence is needed and penalizing redundant tool calls, the authors train an 8B‑parameter model that shows improved accuracy and tool‑use efficiency across seven image‑grounded benchmarks. The approach demonstrates that fine‑grained supervision of tool‑evidence paths is essential for robust agentic VLM performance.

By Xingming Long, Yu Liu, Zhiwei Yang, Hanqi Feng, Shaojie Zhang, Barnabas Poczos, Chao Jiang, Zhenbo Luo, Lei Jiang, Pei Fu
arXiv AI
Aug 18

Handoff-H1: An Orchestrated Vision-Agent System for Material Quantity Takeoff from Construction Blueprints

arXiv:2608. 15032v1 Announce Type: cross Abstract: Converting a set of architectural blueprints into a complete material quantity takeoff requires visual perception across drawing sheets, dimensional and multi-hop reasoning, and grounding in construction conventions that the drawings never state.

By Bruno Chicelli, Henrique Alves, Rodrigo Anselmo, Joshua Weinberg, Felipe Lemos, Jan Baryla
arXiv AI
Aug 25

ATP-Bench: Towards Agentic Tool Planning for MLLM Interleaved Generation

ATP‑Bench proposes a new benchmark for evaluating agentic tool planning in multimodal large language models (MLLMs) that generate interleaved text-and-image responses. The benchmark contains 7,702 QA pairs, including 1,592 visual‑question‑answer pairs, across eight categories and 25 visual‑critical intents, all verified by humans. A Multi‑Agent MLLM‑as‑a‑Judge (MAM) system is introduced to assess tool‑call precision, missed opportunities, and overall response quality without relying on ground‑truth references.

By Yinuo Liu, Zi Qian, Heng Zhou, Jiahao Zhang, Yajie Zhang, Zhihang Li, Mengyu Zhou, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang