arXiv AI By Ziang Cui, Mengran Yu, Chenyu Shi, Yingxuan Shi, Tianjiao Li

HOMURA: Taming the Sand-Glass for Time-Constrained LLM Translation via Reinforcement Learning

Read the original on arXiv AI →

The paper introduces Sand-Glass, a benchmark for evaluating translation under syllable-level duration constraints, and proposes Homura, a reinforcement learning framework that optimizes the trade-off between semantic preservation and temporal compliance. Homura uses a constrained reinforcement learning objective with a dynamic syllable-ratio reward to effectively control output length. Experimental results show that Homura outperforms strong baselines, achieving precise length control while maintaining semantic adequacy.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 7

Reinforcement Learning for improving Large Language Models' Catalan text simplification capabilities

The paper explores using reinforcement learning to enhance automatic text simplification for low‑resource languages, focusing on Catalan. It introduces a new reward function that blends the SARI metric with penalty terms, and applies Group Relative Policy Optimization (GRPO) to fine‑tune the IberianLLM‑7B‑Instruct model on the ASSET dataset. Post‑training, the model shows improved simplification performance on two Catalan benchmarks and reduces prior negative behaviors, though cross‑lingual transfer from English, Spanish, and Catalan translations of ASSET does not yield significant gains on an out‑of‑domain benchmark.

By Arnau Ayguad\'e Domingo, Stefan Bott, Horacio Saggion
arXiv AI
Jun 9

Rewrite to Translate, Translate to Reward: Reinforcement Learning for Source Rewriting in Machine Translation

arXiv:2606. 08011v1 Announce Type: cross Abstract: Although directly prompting off-the-shelf Large Language Models (LLMs) to generate meaning-preserving source rewrites can effectively enhance Machine Translation (MT) quality, doing so requires manually tuning prompts for different MT models.

By Boxuan Lyu, Haiyue Song, Zhi Qu, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu Okumura
arXiv Machine Learning
Jun 2

HMPO: Hybrid Median-length Policy Optimization for Chain-of-Thought Compression

arXiv:2606. 01934v1 Announce Type: new Abstract: Large language models achieve remarkable performance via extended chain-of-thought (CoT) reasoning, yet this lengthy process incurs substantial inference overhead.

By Minghui Zheng, Hongxu Chen, Huimin Ren, Hongsheng Xin, Xiaoyang Qu, Ze Wang, Shuling Yang, Ziyu Peng, Kaike Zhang, Pan Zhou, Kun Zhan