arXiv Machine Learning July 17, 2026 By Changhai Zhou, Kieran Liu, Yuhua Zhou, Qian Qiao, Jun Gao, Harry Zhang, Irvine Lu, Nolan Ho, Lucian Li, Andrew Lei, Cleon Cheng, Steven Chiang, Yihang Zeng, Di Zhang, Rio Yang, Kaijie Chen, Andrew Chen, Pony Ma, Weizhong Zhang, Cheng Jin

LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget

Read the original on arXiv Machine Learning →

arXiv:2607. 14952v1 Announce Type: new Abstract: A growing gap separates inference context lengths from RL post-training: inference systems are approaching million-token contexts, while post-training workloads often remain at 256K tokens or below and rely on length generalization at deployment.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 11

ATMA: Long-Context Language Modeling via Polar Attention and Gated-Delta Compression Memory

arXiv:2606. 25156v3 Announce Type: replace-cross Abstract: Native length extrapolation remain a weakly solvable problem in language modeling due to trade-off balancing between exact retrieval fidelity, long-document likelihood, and inference efficiency.

By Habibullah Akbar

benchmarks

arXiv AI

Jun 3

Libra: Efficient Resource Management for Agentic RL Post-Training

arXiv:2606. 03077v1 Announce Type: cross Abstract: Reinforcement learning (RL) has become a standard post-training paradigm for large language models (LLMs), extending beyond preference alignment to complex reasoning and multi-turn agentic behaviors.

By Kaiwen Chen, Xin Tan, Jingzong Li, Hong Xu

llms agents reinforcement-learning efficiency safety

arXiv Machine Learning

Jul 7

Learning When to Attend: Conditional Memory Access for Long-Context LLMs

arXiv:2603. 17484v2 Announce Type: replace-cross Abstract: Language models struggle to generalize beyond pretraining context lengths, limiting long-horizon reasoning and retrieval.

By Sakshi Choudhary, Aditya Chattopadhyay, Luca Zancato, Elvis Nunez, Matthew Trager, Wei Xia, Stefano Soatto

llms efficiency

arXiv AI

Jun 9

End-to-End Context Compression at Scale

arXiv:2606. 09659v1 Announce Type: cross Abstract: Long-context language model inference is bottlenecked by memory, as the KV cache grows with context length.

By Ang Li, Sean McLeish, Haozhe Chen, Nimit Kalra, Zaiqian Chen, Artem Gazizov, Venkata Anoop Suhas Kumar Morisetty, Bhavya Kailkhura, Harshitha Menon, Zhuang Liu, Brian R. Bartoldson, Tom Goldstein, Sanae Lotfi, Micah Goldblum, Pavel Izmailov

llms rag agents efficiency

arXiv Machine Learning

Aug 4

Bole: Efficient Tree Speculation for Hybrid-Attention Language Models

arXiv:2608. 01651v1 Announce Type: cross Abstract: Hybrid-attention large language models combine full attention with recurrent linear attention to reduce long-context inference costs, yet their autoregressive decoding remains memory-bound.

By Li Wang, Yi Su, Xiabao Wu, Chiran You, Yongchao Liu, Zhan Qiu, Juelu Zhang, Jiajun Zheng, Fangxin Liu, Jie Zhang, Chen Tian, Chengying Huan

llms agents efficiency

arXiv AI

Aug 12

Efficient Reinforcement Learning for Long-Horizon Tool-Use Agentic Tasks

arXiv:2608. 10357v1 Announce Type: cross Abstract: Long-horizon tool-using agents must reason over user goals, domain policies, tool calls, simulator state, and delayed verifiable rewards.

By Zelei Cheng, Amritansh Mishra, Sambit Sahu, William Campbell

agents reinforcement-learning benchmarks

Related stories

ATMA: Long-Context Language Modeling via Polar Attention and Gated-Delta Compression Memory

Libra: Efficient Resource Management for Agentic RL Post-Training

Learning When to Attend: Conditional Memory Access for Long-Context LLMs

End-to-End Context Compression at Scale

Bole: Efficient Tree Speculation for Hybrid-Attention Language Models

Efficient Reinforcement Learning for Long-Horizon Tool-Use Agentic Tasks