arXiv AI June 19, 2026 By Faqiang Qian, Kang An, Weikun Zhang, Ziliang Wang, Xuhui Zheng, Liangjian Wen, Yong Dai, Mengya Gao, Yichao Wu

AAPA: Adversarially Anchored Preference Alignment for Post-Training of Large Language Models

Read the original on arXiv AI →

arXiv:2509. 25148v2 Announce Type: replace Abstract: Post-training alignment of large language models often combines supervised fine-tuning (SFT) on expert demonstrations with reinforcement learning (RL) from preference or verifiable feedback.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Jul 14

Agentic-DPO: From Imitation to Agentic Policy Optimization on Expert Trajectories

arXiv:2607. 10601v1 Announce Type: new Abstract: Large Language Model (LLM) agents are commonly trained from expert trajectories using supervised fine-tuning (SFT), which treats multi-turn agent behavior as ordinary text imitation.

By Yixiong Chen, Alan Yuille

llms agents reinforcement-learning fine-tuning

arXiv AI

Jun 11

Toward Preference-aligned Large Language Models via Residual-based Model Steering

arXiv:2509. 23982v2 Announce Type: replace-cross Abstract: Preference alignment is a critical step in making Large Language Models (LLMs) useful and aligned with (human) preferences.

By Lucio La Cava, Andrea Tagarelli

llms reinforcement-learning benchmarks safety

arXiv Machine Learning

Jul 30

Meta-Learned Reward Shaping for Reinforcement Learning from Human Feedback

arXiv:2607. 26094v1 Announce Type: new Abstract: Reinforcement Learning from Human Feedback (RLHF) is the standard approach for aligning large language models with human preferences, but its quality is limited by static, task-agnostic reward models.

By Yunpeng Chu

llms reinforcement-learning benchmarks safety

arXiv Computation and Language

Sep 22

Team DArgk at the 2026 ELOQUENT lab for evaluating generative language model quality: Residuals of Humanity: AI Detection Evasion via GRPO Fine-Tuning

arXiv:2609.22221v1 Announce Type: new Abstract: Large language models (LLMs) can generate fluent and coherent text that is increasingly difficult to distinguish from human writing, motivating the dev...

By Antonela Tommasel, Juan Manuel Rodriguez

llms reinforcement-learning fine-tuning safety

arXiv AI

Aug 11

Proxy OPD: On-Policy Distillation with Transferable Relative Proxy Update

arXiv:2607. 11505v2 Announce Type: replace-cross Abstract: Post-training for large language models typically couples policy exploration with model optimization, hindering the reuse of high-reward behaviors from policy exploration.

By Daocheng Fu, Rong Wu, Yu Yang, Jianbiao Mei, Licheng Wen, Pinlong Cai, Xuemeng Yang, Yong Liu, Botian Shi, Yu Qiao

llms efficiency

arXiv AI

Aug 12

Evaluation-Conditioned Training: Teaching Models to Generalize to Stronger Oversight Regimes

arXiv:2608. 10209v1 Announce Type: new Abstract: Feedback signals used to train Large Language Models (LLMs) are the primary driver of their behavior and our main lever for instilling alignment with human values and objectives.

By Alec Harris, Kasey Corra, Archie Chaudhury, Yixiong Hao

llms reinforcement-learning fine-tuning safety

One email a morning, machine-written

Related stories

Agentic-DPO: From Imitation to Agentic Policy Optimization on Expert Trajectories

Toward Preference-aligned Large Language Models via Residual-based Model Steering

Meta-Learned Reward Shaping for Reinforcement Learning from Human Feedback

Team DArgk at the 2026 ELOQUENT lab for evaluating generative language model quality: Residuals of Humanity: AI Detection Evasion via GRPO Fine-Tuning

Proxy OPD: On-Policy Distillation with Transferable Relative Proxy Update

Evaluation-Conditioned Training: Teaching Models to Generalize to Stronger Oversight Regimes