arXiv Computation and Language By Anton Xue, Alan Li, Rahul Saha

Multi-Target Few-Shot Prompting with Diffusion Language Models

Read the original on arXiv Computation and Language →

The paper introduces multi-target few-shot prompting using diffusion language models, enabling the infilling of multiple masked regions within a shared canvas guided by examples. It addresses challenges in few-shot prompting by selectively masking the canvas to derive a likelihood-ratio reward that favors example-supported infills. Experiments on prompting benchmarks and software refactoring case studies show that demonstrations improve infilling accuracy and provide additional gains in several settings.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computer Vision
Oct 28

Hy-Nomas: Towards Free-form Interactive World Generation

Hy‑Nomas is an 8B diffusion‑based video world model that enables free‑form text instructions and continuous camera control across multiple interaction turns. It generates variable‑length video segments conditioned on current inputs and cached history, using structured video captions and action‑aware causal attention to keep descriptive context accessible while restricting action instructions to their intended temporal windows. A vision‑language Prompt Enhancer translates user requests and multimodal histories into structured conditions, and a multi‑stage curriculum trains the model progressively before diffusion distillation, resulting in superior performance in human evaluations.

By Qiaoling Chen, Jiaxiang Cheng, Xueqing Deng, Tiankai Hang, Ji Hou, Jiaqi Li, Yifan Liu, Tao Lu, Junshu Tang, Yu Tang, Yao Teng, Yu Tian, Heng Wang, Weizhi Wang, Xiyao Wang, Xilun Wu, Mingyu Yang, Yangbin Yu, Rui Zhao, Longjun Cao, Linghao Chen, Haoyi Duan, Jiaming Han, Mingji Han, Enhua Jiang, Shunkai Li, Yanzhe Liang, Qinwei Ma, Cong Wang, Lei Wang, Bing Wu, Ke Xing, Ray Ying, Zhentao Yu, Key Zhang, Yuan Zhou, Zhengguang Zhou, Kai Zou
arXiv AI
Sep 30

PreviewDiff: Multimodal Critic-Guided Search over Diffusion Latents

PreviewDiff is a test‑time search method that uses multimodal critics to guide diffusion model sampling. By decoding partial previews at selected denoising checkpoints, scoring them with a multimodal judge, and branching over semantic prompt edits, it allows the generation process to be edited and rerouted before completion. The approach consistently outperforms budget‑matched Best‑of‑N sampling and scalar‑search baselines on image and video benchmarks, with early interventions and wider search yielding the biggest gains.

By Vighnesh Subramaniam, Boris Katz, Brian Cheung, Chun-Liang Li, Tomas Pfister, Yale Song