arXiv Computer Vision By Yinming Huang, Shuyuan Tu, Xi Yan, Zihan Yang, Jianhua Han, Xu Hang, Yu-Gang Jiang, Zuxuan Wu

VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation

Read the original on arXiv Computer Vision →

arXiv:2608. 18607v2 Announce Type: replace Abstract: Using reinforcement learning to post-train joint video-audio generation models requires a reward signal.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Hugging Face Trending Papers
4d ago

AVC-Reward: Event-Centric Audio-Video Consistency Evaluation

AVC-Reward introduces an event‑centric framework for evaluating audio‑video consistency in joint generation models. It separates audio and visual events, assesses them independently, cross‑validates cross‑modal relations, and aggregates results into a three‑level metric covering global narrative harmony, event‑level synchronization, and fine‑grained attribute alignment. The resulting AVC‑Reward model aligns closely with human judgments, offers interpretable failure localization, and enhances consistency when used as a reinforcement‑learning signal.

arXiv AI
3d ago

AVC-Reward: Event-Centric Audio-Video Consistency Evaluation

AVC-Reward introduces an event‑centric framework for evaluating audio‑video consistency, breaking down scenes into individual audio and visual events and assessing them at three levels: global narrative harmony, event‑level temporal synchronization, and fine‑grained attribute alignment. The metric, instantiated as a trainable reward model, is validated against human judgments using the AVC‑Benchmark, which contains diverse positive and negative samples from various generation models. AVC‑Reward outperforms existing automatic methods, offers interpretable failure localization, and enhances consistency when used as a reinforcement‑learning signal.

By Yuruo Wu, Kaihang Pan, Kai Shen, Jiacheng Li, Shuyuan Tu, Jisheng Dang, Li Tuoyu, Juncheng Li, Siliang Tang
arXiv AI
Aug 25

Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation

arXiv:2608.21425v1 Announce Type: cross Abstract: Video generation is central to AI-powered content creation. Aligning generated videos with human preferences is a key criterion for evaluating genera...

By Nai-Xin Zhai, Weihua Cheng, Dexu Yu, Yikai Gu, Hanwen Du, Junchen Fu, Chenxi Huang, Yingwei Song, Liyuan Lillian Ma, Yang Ran, Youhua Li, Yongxin Ni