arXiv Machine Learning June 25, 2026 By Samuel Valland Lyngset, Tor Viljen Raanaas, Gard Sveipe, Eirik M{\o}ller Nilsen, Jim Torresen, Kai Olav Ellefsen, Tobias L{\o}mo

Memory-Efficient Policy Libraries with Low-Rank Adaptation in Reinforcement Learning

Read the original on arXiv Machine Learning →

arXiv:2606. 25700v1 Announce Type: new Abstract: When fine-tuning Large Language Models (LLMs), there has been success in minimizing both memory usage and computation with Parameter-Efficient Fine-Tuning (PEFT), like Low Rank Adaptation (LoRA).

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision

3d ago

Inline Memory Meets Reusable Skills: Memory-centric Framework for Vision-Language-Action Model

arXiv:2609.39794v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have shown strong promise for general-purpose robotic manipulation, yet adapting them to new tasks and domains rema...

By Zaijing Li, Rui Shao, Bing Hu, Haoyu Zhang, Dongmei Jiang, Liqiang Nie

robotics fine-tuning multimodal

arXiv AI

Jun 29

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks?

arXiv:2605. 30719v2 Announce Type: replace-cross Abstract: We study when large language models (LLMs) can serve as effective black-box policy optimizers for reinforcement learning (RL) tasks, i.

By Stephane Hatgis-Kessell, Emma Brunskill

llms reinforcement-learning robotics

arXiv AI

Sep 7

A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning

The paper presents a decentralized navigation framework for composite heterogeneous robots that integrates a large language model (LLM) policy agent, an Upper Confidence Bound (UCB) bandit, and a Double Deep Q-Network (Double DQN) controller. Each robot independently generates and refines policies at the round level using LLM inference, while the Double DQN handles tick-level action selection based on navigation variables and LLM priors. Across 30 rounds, the full configuration achieved all goals with the lowest median completion time (42 ticks) and a 25–39% improvement over other setups.

By Chongwen Dong, Mithun Paul Saint-Germain, Pinjari Asif, Carlo R. daCunha

llms agents reinforcement-learning robotics

arXiv AI

2d ago

Divide-and-Remember: Recursive Action-Relevant Memory for Long-Horizon VLA Policies

arXiv:2610.00982v1 Announce Type: cross Abstract: Vision-language-action (VLA) models struggle on history-dependent manipulation tasks, where the current observation alone does not determine the acti...

By Xuehui Yu, Eason Yu, Meiyi Wang, Haozhe Du, Stefano V. Albrecht, Harold Soh

robotics multimodal benchmarks

arXiv AI

Jul 23

Leveraging Offline Supervision for Efficient and Generalizable Reinforcement Learning in Large-Scale Vision-Language-Action Models

arXiv:2607. 19399v1 Announce Type: cross Abstract: It is commonly observed that online reinforcement learning (RL) produces better-performing strategies than offline methods across a broad range of performance measures.

By Dmitriy Poyarkov, Aleksei Staroverov, Aleksandr I. Panov

reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Jun 15

Rethinking the Trust Region in LLM Reinforcement Learning

arXiv:2602. 04879v3 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has become a cornerstone for fine-tuning Large Language Models (LLMs), with Proximal Policy Optimization (PPO) serving as the de facto standard algorithm.

By Penghui Qi, Xiangxin Zhou, Zichen Liu, Tianyu Pang, Chao Du, Min Lin, Wee Sun Lee

llms reinforcement-learning fine-tuning efficiency

One email a morning, machine-written

Related stories

Inline Memory Meets Reusable Skills: Memory-centric Framework for Vision-Language-Action Model

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks?

A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning

Divide-and-Remember: Recursive Action-Relevant Memory for Long-Horizon VLA Policies

Leveraging Offline Supervision for Efficient and Generalizable Reinforcement Learning in Large-Scale Vision-Language-Action Models

Rethinking the Trust Region in LLM Reinforcement Learning