The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
MatReplace is a new reference‑free benchmark for evaluating material replacement in interior scenes, assessing edits on local material correctness, global lighting harmony, outside preservation, and inside structure. It offers three tracks that vary the conditioning signal—instruction only, instruction plus region mask, and material reference image—allowing systematic comparison of different editing approaches. Results show that while closed‑source editors excel at named‑material rendering, grounding materials from pixel references remains a significant challenge.
The paper introduces a counterfactual benchmark to evaluate whether vision models understand physical constraints or merely learn rendering shortcuts. Using Mitsuba 3, it generates 5,500 synthetic images across 500 scene families, each with a clean image and ten violations (shadows, reflections, support, surface response, occlusion). Diagnostic baselines (LLaVA‑1.5‑7B, Qwen2.5‑VL‑7B, InternVL3.5‑8B) achieve 64.0–67.8 % macro‑F1 on a held‑out synthetic test set, but performance drops to 40.8 % for LLaVA‑1.5‑7B under an intervention shift, indicating reliance on rendering cues rather than true physical reasoning.
arXiv:2608. 06075v1 Announce Type: cross Abstract: Commercial vision-language models are reshaping computer vision, with visual priors broad enough to rival task-specific systems.
Commercial vision-language models are reshaping computer vision, with visual priors broad enough to rival task-specific systems. This raises a natural question: do they reduce the need for classic, physics-informed low-level vision?
SREdit is a response‑guided framework that improves projection‑based appearance editing by estimating a scene response map from a reconstructed scene. This map indicates how strongly projected illumination can affect different surface regions, allowing the system to adapt editing strength across the object while preserving registration with the fixed physical surface. Experiments with two pretrained image editors show that SREdit enhances projected appearance quality and reproduction fidelity, adding less than one second per image with negligible VRAM overhead, and participants consistently preferred its results in a user study.
arXiv:2607. 22705v1 Announce Type: cross Abstract: Object-centric learning aims to represent scenes as objects whose properties can be reused in new combinations.