arXiv Computation and Language By Marius Memmel, Shawn Yin, Urvi Rutia, Angad Wadhwa, Eldon Li, Gavin Angeloff, Ankit Goyal, Jesse Zhang, Dieter Fox, Fabio Ramos, Anqi Li, Abhishek Gupta

D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models

Read the original on arXiv Computation and Language →

The paper introduces D&A (Describe & Assess), a prompt-based method that separates progress estimation into a textual description of scene dynamics and a subsequent assessment using explicit rubrics. By requiring Vision‑Language Models to generate an explicit definition of absolute success before scoring, D&A anchors evaluations to an external criterion, reducing confirmation bias and providing fine‑grained, partial progress metrics. Empirical results show that D&A matches or surpasses post‑trained reward models across tasks, embodiments, and benchmarks, and its reward estimates support efficient downstream reinforcement learning.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Hugging Face Trending Papers
4d ago

D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models

The paper introduces D&A (Describe & Assess), a prompt‑based method that separates vision‑language model progress estimation into a textual description of scene dynamics and a rubric‑based assessment. By requiring the model to explicitly define absolute success before scoring, D&A reduces confirmation bias and provides fine‑grained, partial progress metrics that accurately penalize failures and interpolate successes. The approach generalizes across tasks, embodiments, and benchmarks, matching or surpassing post‑trained reward models while enabling efficient downstream reinforcement learning.

arXiv AI
Jul 24

TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Robotics

arXiv:2602. 19313v2 Announce Type: replace-cross Abstract: General-purpose robot learning requires dense, instruction-conditioned feedback that can distinguish meaningful task progress from stalled, failed, or partially completed behavior.

By Shirui Chen, Cole Harrison, Ying-Chun Lee, Angela Jin Yang, Zhongzheng Ren, Lillian J. Ratliff, Jiafei Duan, Dieter Fox, Ranjay Krishna
arXiv AI
Jun 2

From Demonstrations to Rewards: Test-Time Prompt Optimization for VLM Reward Models

arXiv:2606. 00083v1 Announce Type: cross Abstract: Reinforcement learning relies on accurate reward functions, which are often hand-crafted or even unavailable in real-world applications, such as robotics.

By Christian Gumbsch, Leonardo Barcellona, Lennard Sch\"unemann, Platon Karageorgis, Andrii Zadaianchuk, Zehao Wang, Sergey Zakharov, Fabien Despinoy, Rahaf Aljundi, Efstratios Gavves
arXiv Computer Vision
Aug 27

Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization

Zero-WAM introduces a causal video-action model that enables robots to perform unseen manipulation tasks by following in-context human video guidance. The authors create HumanGen, a dataset of 74.2K human-robot ICL pairs across 8.6K tasks, and propose an in-context future chunk prediction objective to prevent shortcut learning. In simulation, Zero-WAM attains a 47.0% success rate on seven unseen tasks, outperforming the best video-action baseline by 29.5 percentage points, and demonstrates real‑world generalization to complex, long‑horizon, and fine‑grained tasks.

By Jiaming Zhou, Qihang Zhang, Gangwei Xu, Cunxin Fan, Yujie Zhao, Ruilin Wang, Yiming Luo, Shuai Yang, Xing Zhu, Yujun Shen, Junwei Liang, Yinghao Xu