InfiniteWorld: Separating Visual Evidence from Familiar Physics
Read the original on arXiv AI →InfiniteWorld is a new benchmark that pairs physical‑reasoning questions with simulator videos whose physical parameters are systematically altered, allowing researchers to test whether models rely on visual evidence or on familiar physics. The benchmark’s generation pipeline connects simulation, scene screening, paired video translation, question construction, and input checks, and it includes five tasks—law identification, parameter estimation, temporal reasoning, analytic counterfactual comparison, and law induction. Evaluation across five matched input settings (text‑only, ordered, shuffled observations) reveals that video‑language models often default to Earth‑normal physics, showing strong accuracy on normal questions but poor recognition of altered dynamics. "whyItMatters":"The benchmark provides a measurable way to separate visual evidence from familiar physics, exposing persistent biases in current video‑language models toward Earth‑normal rules."
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.