arXiv Computation and Language By Eran Goldstein, Yuval Belfer, Yonatan Belinkov, Daniel Gissin

LIFT: Scoped Constraints for Evaluating and Training Instruction Following

Read the original on arXiv Computation and Language →

LIFT introduces Lift-Bench, a new instruction‑following benchmark that asks language models to draft a document based on a topic and a structured outline, with constraints scoped to specific sections for finer control. The benchmark includes both verifiable and judged constraints and a training counterpart, Lift‑Train, designed to reduce reward hacking by providing both main‑task and instruction‑following constraints. Experiments show that state‑of‑the‑art models struggle with the harder subsets, and training on Lift‑Train is less prone to reward hacking than traditional IF training.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Hugging Face Trending Papers
Jul 30

IFHierBench: Hierarchical Instruction Following for Large Language Models

Instruction-following ability is critical for deploying large language models in real-world applications, where downstream components depend on the output satisfying specific constraints. Modern deployments increasingly handle the full task in a single LLM call, with one prompt specifying a layered output whose overall artifact, structural sections, and nested fields must each satisfy concrete constraints.

arXiv Machine Learning
Jun 9

TinyJudge: Unverifiable Constraint Alignment via Lightweight Specialist Ensembles

arXiv:2606. 07520v1 Announce Type: cross Abstract: Instruction Following (IF) is a core capability of LLMs, requiring strict adherence to diverse constraints, ranging from verifiable ones (e.

By Yirong Zeng, Yufei Liu, Xiao Ding, Yutai Hou, Yuxian Wang, Wu Ning, Haonan Song, Dandan Tu, Qixun Zhang, Yuxiang He, Bibo Cai, Ting Liu