arXiv:2608. 16765v1 Announce Type: cross Abstract: Despite recent advances in unified multimodal models for multi-reference image generation, existing benchmarks remain organized around predefined task types (e.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.
arXiv:2610.32459v1 Announce Type: new Abstract: Image generation models have rapidly advanced, with many models now supporting generation conditioned on multiple reference images and textual instruct...
The paper introduces Auto-Comp, a fully automated, concept-driven pipeline that generates photorealistic compositional benchmarks for vision‑language models. Auto‑Comp creates paired Minimal and Contextual samples for each concept, enabling isolation of core binding abilities from visio‑linguistic complexity. Evaluations across 25 models reveal consistent failures in attribute and relational binding, with context helping relational tasks but hindering attribute tasks due to visual clutter.
arXiv:2609.37709v1 Announce Type: cross Abstract: Recent multimodal image generation models can take multiple images and textual instructions as input, enabling reference-based generation guided not...
Imag‑Eval is a new language‑grounded benchmark for evaluating Text‑to‑Image models, focusing on how well they follow compositional natural‑language instructions. It disentangles prompt length from compositional difficulty by independently varying the number of instances and the combination of constraints (rules), providing 1,140 prompts and 8,842 rule combinations. The study shows that for structured skills, the difficulty is mainly driven by the number of grounded rules and their binding to instances rather than prompt length alone.
arXiv:2609.31456v1 Announce Type: new Abstract: Vision-language models (VLMs) often struggle with compositional reasoning tasks, but the reasons for this underperformance remain unclear. A common hyp...
WOVEN is a new training source and benchmark for visual transition reasoning, comprising 36,076 examples across 20 scenes, 5 actions, and 8 reasoning types. The study shows that current multimodal large language models (MLLMs) have a systematic deficit in spatial, embodied, physical, and temporal reasoning, and that training on WOVEN improves performance on 22 of 26 external benchmarks by up to 27.3 percentage points. The authors also provide a training recipe that prioritizes reasoning operations and larger visual changes for robust visual world modeling.