arXiv Computation and Language By Ying Li, Xinglin Lyu, Junhui Li, Jinlong Yang, Hengchao Shang, Min Zhang, Shimin Tao, Daimeng Wei

Cross-Preference Learning for Sentence-Level and Context-Aware Machine Translation

Read the original on arXiv Computation and Language →

The paper introduces Cross-Preference Learning (CPL), a training framework that explicitly models the complementary strengths of sentence-level and context-aware machine translation. By incorporating intra- and cross-condition preferences into the optimization objective, CPL provides targeted supervision to leverage useful contextual signals while remaining robust to uninformative context. Experiments on multiple public context-aware MT tasks with models such as Qwen3-4B, Qwen3-8B, and Llama-3-8B-Instruct show consistent improvements in translation quality and robustness without altering the model architecture.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Sep 1

Beyond "To whom it may concern": Tailoring Machine Translation to Audience and Intent

The paper investigates how machine translation can be tailored to specific audiences and intents, a capability enabled by large language models (LLMs). By systematically evaluating purpose-driven MT across 50 languages, 5 model sizes, and 8 text domains, the authors find that explicit instructions significantly improve translation adaptiveness, especially for informal domains, larger models, and higher-resource languages. They also show that traditional MT metrics often penalize adapted translations and that models can self-generate useful instructions from context, closing a large portion of the adaptiveness gap.

By Raphael Merx, Ekaterina Vylomova, Trevor Cohn
arXiv AI
Sep 15

Balancing Global Quality and Pronoun-Specific Feedback for Context-Aware Machine Translation

The paper introduces ProNMT, a reward-guided iterative self‑training approach that balances global translation quality with pronoun‑specific feedback for context‑aware machine translation. ProNMT samples candidate translations, scores them using reference‑free quality estimation and a pronoun label derived from references, and fine‑tunes on the highest‑scoring candidate. Experiments on English–German Europarl and English–French News Commentary show that ProNMT outperforms standard context‑aware fine‑tuning on BLEU and COMET, while ablations reveal that pronoun‑only feedback can harm overall quality and that confidence‑weighted feedback outperforms hard binary feedback.

By Harshit Dhankhar, Baban Gain, Asif Ekbal, Yogesh Mani Tripathi
arXiv Computation and Language
Oct 15

Copy-Paste Language Models

arXiv:2610.19247v1 Announce Type: new Abstract: Transformers are intuitively considered to be efficient at copying from their inputs. We actually show that the ability of LLMs to copy in context can...

By Nathan Godey, Yoav Artzi