arXiv AI By Shilin Hu, Jingyi Xu, Dimitris Samaras, Hieu Le

Domain-Grounded Candidate Selection for Agentic Image Editing: A Shadow Removal Case

Read the original on arXiv AI →

arXiv:2608. 06075v1 Announce Type: cross Abstract: Commercial vision-language models are reshaping computer vision, with visual priors broad enough to rival task-specific systems.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 1

After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data

The paper introduces AgenticShadow, a new dataset of 17,138 image‑mask‑target triplets created through an offline agentic workflow that combines physics‑motivated generation, failure detection, feedback‑driven retry, candidate selection, and deterministic correction. This approach addresses the long‑standing lack of diverse paired shadow‑free training data by leveraging existing shadow detection datasets and producing realistic shadow‑free targets. Models trained on AgenticShadow show significant improvements, reducing color distribution differences by 50.5% and cross‑domain LAB RMSE by 19.7‑37.5% compared to prior work.

By Shilin Hu, Jingyi Xu, Dimitris Samaras, Hieu Le
arXiv Computer Vision
Oct 8

Do Vision Models Learn Physical Constraints or Rendering Shortcuts? A Counterfactual Benchmark for Grounded Physical Consistency

The paper introduces a counterfactual benchmark to evaluate whether vision models understand physical constraints or merely learn rendering shortcuts. Using Mitsuba 3, it generates 5,500 synthetic images across 500 scene families, each with a clean image and ten violations (shadows, reflections, support, surface response, occlusion). Diagnostic baselines (LLaVA‑1.5‑7B, Qwen2.5‑VL‑7B, InternVL3.5‑8B) achieve 64.0–67.8 % macro‑F1 on a held‑out synthetic test set, but performance drops to 40.8 % for LLaVA‑1.5‑7B under an intervention shift, indicating reliance on rendering cues rather than true physical reasoning.

By M. Moein Esfahani, Sepehr Salem, Mohammed Alser, Vince Calhoun
arXiv AI
Aug 26

MatReplace: A Reference-Free, Conditioning-Aligned Benchmark for Material Replacement in Interior Scenes

MatReplace is a new reference‑free benchmark for evaluating material replacement in interior scenes, assessing edits on local material correctness, global lighting harmony, outside preservation, and inside structure. It offers three tracks that vary the conditioning signal—instruction only, instruction plus region mask, and material reference image—allowing systematic comparison of different editing approaches. Results show that while closed‑source editors excel at named‑material rendering, grounding materials from pixel references remains a significant challenge.

By Mingzhe Du, Thong Thanh Nguyen, Nguyen Tran Cong Duy, See-Kiong Ng, Luu Anh Tuan