arXiv Computer Vision
ACWM-RM: A Reference-Free Reward Model from Complementary Mismatch Preferences
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Sep 4
WorldReward: Reward Modeling for Camera-Conditioned World Models
WorldReward introduces a vision‑language model–based reward system for camera‑conditioned world models, combining action consistency and visual quality evaluation. It processes paired videos by splitting them into action‑aligned chunks, structuring visual evidence, and aggregating decisions through voting. The model is trained on a large, reasoning‑augmented preference dataset and outperforms GPT‑5.5 on a human‑annotated benchmark, improving both action execution and visual quality when applied to RL post‑training.
arXiv AI
Oct 15
IsoVRBench: Video Reward Modeling Without Human Feedback
arXiv:2610.17234v1 Announce Type: new Abstract: Video reward models are trained and evaluated on human preferences between videos that often differ simultaneously on properties such as prompt alignme...
arXiv Computer Vision
Sep 22
RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling
arXiv:2609.22947v1 Announce Type: new Abstract: Reinforcement learning (RL) is vital for optimizing video generation models, with a robust reward model (RM) serving as the cornerstone. However, exist...
arXiv Computer Vision
Oct 12
SimVTA: Simulation-Grounded Video-Trajectory Alignment for Driving World Action Models
SimVTA is a post‑training framework that enhances driving world action models by aligning simulated future videos with candidate trajectories. It samples trajectories, renders high‑reward futures in a real‑world simulator using 3D Gaussian Splatting, and prioritizes video supervision for high‑error futures. The approach improves planning performance, raising PDMS from 86.2 to 91.3 on NAVSIM v1 and achieving strong results on NAVSIM v2 and HUGSIM.
arXiv Computer Vision
Oct 2
Token-Level Video Reinforcement Learning
arXiv:2610.01973v1 Announce Type: new Abstract: Reinforcement learning (RL) for video generation usually assigns one scalar reward to an entire sampled video. Yet a video is not uniformly flawed: som...
arXiv AI
Jul 3
Rank-Then-Act: Reward-Free Control from Frame-Order Progress
arXiv:2607. 01897v1 Announce Type: cross Abstract: We introduce Rank-Then-Act (RTA), a framework for learning control policies from expert video demonstrations without environment rewards.