arXiv Machine Learning August 12, 2026 By Lang Zhou, Shuxuan Li, Zhuohao Li, Shi Liu, Zhilin Zhao, Wei-Shi Zheng

UT-ACA: Uncertainty-Triggered Adaptive Context Allocation for Long-Context Inference

Read the original on arXiv Machine Learning →

arXiv:2603. 18446v2 Announce Type: replace-cross Abstract: Long-context inference remains challenging for large language models due to attention dilution and out-of-distribution degradation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Sep 1

DIP: Dynamic In-Context Planner For Diffusion Language Models

arXiv:2601.03199v2 Announce Type: replace-cross Abstract: Diffusion language models (DLMs) have shown strong potential for general natural language tasks with in-context examples. Existing In-Context...

By Yang Li, Han Meng, Chenan Wang, Zhenyu Bi, Xuan Wang, Haipeng Chen

llms diffusion benchmarks

arXiv Machine Learning

Sep 10

Retrieval-augmented Decoding for Improving Truthfulness in Open-ended Generation

The paper introduces Retrieval-Augmented Decoding (RAD), a decoding-time method that improves the truthfulness of large language models without retraining. RAD uses a small reference set of up to ten annotated examples to build a grounding space of context embeddings and next-token logits, which it retrieves and aggregates during inference to shape the model’s output. Experiments on four open-ended generation benchmarks and four different LLMs show that RAD consistently outperforms strong baselines and generalizes well across tasks.

By Manh Nguyen, Sunil Gupta, Hung Le

llms rag reinforcement-learning fine-tuning benchmarks

arXiv AI

Jun 2

ACON: Optimizing Context Compression for Long-horizon LLM Agents

arXiv:2510. 00615v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed as agents in dynamic real-world environments, where success depends on maintaining precise records of actions and observations.

By Minki Kang, Wei-Ning Chen, Dongge Han, Huseyin A. Inan, Lukas Wutschitz, Yanzhi Chen, Robert Sim, Saravan Rajmohan

llms agents fine-tuning

arXiv AI

Aug 7

Cautious Context Steering for Language Model Personalization

arXiv:2608. 05813v1 Announce Type: new Abstract: Personalizing language models (LMs) to individual user preferences is essential for aligning responses with diverse goals and backgrounds.

By Gihoon Kim, Jeyoung Lee, Suhan Woo, Sekwon Oh, Minsu Jeon, Hyounsoo Han, Euntai Kim

llms reinforcement-learning fine-tuning efficiency benchmarks

arXiv AI

Jul 17

PReM: Learning What to Preserve and When to Refresh for Context Compression

arXiv:2607. 14327v1 Announce Type: cross Abstract: Efficient long-context inference is not only about reducing memory cost, but also about keeping useful contextual evidence accessible as generation proceeds.

By Bohan Yu, Lei Shen, Chenxi Zhou, Chen Han, Junlin Liu, Wenbo Su, Yu Cheng, Bo Zheng

arXiv AI

Jun 9

End-to-End Context Compression at Scale

arXiv:2606. 09659v1 Announce Type: cross Abstract: Long-context language model inference is bottlenecked by memory, as the KV cache grows with context length.

By Ang Li, Sean McLeish, Haozhe Chen, Nimit Kalra, Zaiqian Chen, Artem Gazizov, Venkata Anoop Suhas Kumar Morisetty, Bhavya Kailkhura, Harshitha Menon, Zhuang Liu, Brian R. Bartoldson, Tom Goldstein, Sanae Lotfi, Micah Goldblum, Pavel Izmailov

llms rag agents efficiency

One email a morning, machine-written

Related stories

DIP: Dynamic In-Context Planner For Diffusion Language Models

Retrieval-augmented Decoding for Improving Truthfulness in Open-ended Generation

ACON: Optimizing Context Compression for Long-horizon LLM Agents

Cautious Context Steering for Language Model Personalization

PReM: Learning What to Preserve and When to Refresh for Context Compression

End-to-End Context Compression at Scale