arXiv:2610.27756v1 Announce Type: new
Abstract: Vision-language models (VLMs) are exact on small sets and drift into estimation on larger ones, a profile reminiscent of children before they master co...
By Yingxin Jia, Hui Geng, Wenxin Yang, Mohan Zhang
The study measures the exact probability that language models assign to each integer from 1 to N when prompted for a random number, eliminating sampling noise by summing over all spellings. Across 18 open‑weight models and 29 decoding settings, instruction tuning consistently makes the distribution less uniform, introducing a round‑number avoidance heuristic and sharpening endpoint avoidance. While tuned models rarely output the extreme values 1 or N and largely avoid multiples of 10, they do not converge on a single favorite integer across models.
By Samar Ansari
The paper argues that apparent capability limits in vision‑language benchmarks often stem from the way answers are presented rather than from the models themselves. By comparing performance on COCO images with answer choices given as English names versus pixel coordinates, the authors show that models like Qwen3‑VL‑4B perform far better when answers are in natural language, and that the choice of answer format can swing model rankings by dozens of points. The study also demonstrates that different conventions (e.g., hue angles vs. pixel coordinates) reveal which formats a model can actually interpret, highlighting that a fixed answer vocabulary is not neutral across models.
By Alfredo F. Frontera Del Valle
arXiv:2609.23012v1 Announce Type: new
Abstract: Generative vision-language models (VLMs) offer a counting paradigm in which one model produces both a count and a natural-language account of the scene...
By Moshiur Farazi, Bekir Ciftler, Abdulhalim Dandoush, Reda Bendraou
The study investigates a bias in text‑to‑image models that consistently generate analog clocks showing 10:10, a common advertising pose. Researchers tested 52 models on images requiring clocks to display 2:35, 6:50, and 11:20, varying the prompt to include no time, digits, hand positions in words, or a drawn reference dial. Results show that adding a reference dial dramatically improves accuracy (up to 75% correct) while other prompt variations only modestly reduce the 10:10 bias.
By Luca Cazzaniga
arXiv:2609.11149v3 Announce Type: replace-cross
Abstract: How fast does a language model degrade when trained on its own outputs? Theory traces it to gradually accumulating errors, while experiments...
By Yangze Liu, Zhongyi Han