Commercial vision-language models are reshaping computer vision, with visual priors broad enough to rival task-specific systems. This raises a natural question: do they reduce the need for classic, physics-informed low-level vision?
The paper introduces AgenticShadow, a new dataset of 17,138 image‑mask‑target triplets created through an offline agentic workflow that combines physics‑motivated generation, failure detection, feedback‑driven retry, candidate selection, and deterministic correction. This approach addresses the long‑standing lack of diverse paired shadow‑free training data by leveraging existing shadow detection datasets and producing realistic shadow‑free targets. Models trained on AgenticShadow show significant improvements, reducing color distribution differences by 50.5% and cross‑domain LAB RMSE by 19.7‑37.5% compared to prior work.
By Shilin Hu, Jingyi Xu, Dimitris Samaras, Hieu Le
The paper introduces a counterfactual benchmark to evaluate whether vision models understand physical constraints or merely learn rendering shortcuts. Using Mitsuba 3, it generates 5,500 synthetic images across 500 scene families, each with a clean image and ten violations (shadows, reflections, support, surface response, occlusion). Diagnostic baselines (LLaVA‑1.5‑7B, Qwen2.5‑VL‑7B, InternVL3.5‑8B) achieve 64.0–67.8 % macro‑F1 on a held‑out synthetic test set, but performance drops to 40.8 % for LLaVA‑1.5‑7B under an intervention shift, indicating reliance on rendering cues rather than true physical reasoning.
By M. Moein Esfahani, Sepehr Salem, Mohammed Alser, Vince Calhoun
Material replacement is a common interior-design operation: changing the material of a selected surface while preserving its geometry, surroundings, and illumination. Despite its commercial relevance,...
MatReplace is a new reference‑free benchmark for evaluating material replacement in interior scenes, assessing edits on local material correctness, global lighting harmony, outside preservation, and inside structure. It offers three tracks that vary the conditioning signal—instruction only, instruction plus region mask, and material reference image—allowing systematic comparison of different editing approaches. Results show that while closed‑source editors excel at named‑material rendering, grounding materials from pixel references remains a significant challenge.
By Mingzhe Du, Thong Thanh Nguyen, Nguyen Tran Cong Duy, See-Kiong Ng, Luu Anh Tuan
arXiv:2512.06174v3 Announce Type: replace
Abstract: Generating realistic cast shadows for inserted foreground objects requires reasoning about scene geometry and illumination. However, most learning-...
By Shilin Hu, Jingyi Xu, Akshat Dave, Dimitris Samaras, Hieu Le