arXiv Machine Learning

Distributional Active Inference

arXiv:2601. 20985v2 Announce Type: replace Abstract: Optimal control of complex environments with robotic systems faces two complementary and intertwined challenges: efficient organization of sensory state information and far-sighted action planning.

arXiv Machine Learning
Sep 22

Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization

Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization introduces U‑GROW, a lightweight sampling layer that directs more model rollouts toward states with high policy uncertainty, identified as decision‑sensitive stages where small action differences can alter task outcomes. By modifying only the branched‑start distribution, U‑GROW can be integrated into existing model‑based reinforcement learning pipelines without changing the policy optimization objective. Experiments on simulated and real‑world manipulation tasks demonstrate that U‑GROW improves the efficiency and effectiveness of policy optimization for Vision‑Language‑Action models.

By Yifei Sheng, Haoxiang Ren, Zhilong Zhang, Haonan Wang, Runjie Xu, Yihao Sun, Nan Tang, Zhichao Wu, Lei Yuan, Haoxin Lin, Yang Yu
Hugging Face Trending Papers
Aug 10

Renormalising Generative Models for Active Inference: Foundations, Derivations, and Verification

Active inference offers a unified framework for perception, learning, and action, but scaling discrete active-inference models to rich spatial and temporal domains remains difficult. Renormalising generative models (RGMs) address this challenge by composing discrete generative models across spatial and temporal scales, coarse-graining lower-level states and paths into higher-level causes for objects, events, and action.

arXiv AI
Sep 10

Deep Active Inference with Diffusion Policy and Multiple Timescale World Model for Real-World Exploration and Navigation

The paper presents a deep active inference framework for real‑world robotic navigation that combines a diffusion policy with a multiple‑timescale recurrent state‑space model. The diffusion policy generates diverse candidate actions, while the state‑space model predicts long‑horizon outcomes, allowing the system to select actions that minimize expected free energy. Experiments show higher success rates and fewer collisions, especially in exploration‑heavy scenarios, demonstrating the effectiveness of this unified exploration and goal‑directed approach.

By Riko Yokozawa, Kentaro Fujii, Yuta Nomura, Shingo Murata
arXiv AI
Sep 3

Action abstractions for amortized sampling

The paper introduces a method that integrates action abstraction into policy optimization for reinforcement learning and generative flow networks. By iteratively identifying frequently used action subsequences in high‑reward trajectories and treating them as single high‑level actions, the approach expands the action space and improves sample efficiency. Experiments on synthetic and real‑world tasks show that this technique discovers diverse high‑reward states more effectively, especially on challenging exploration problems, and yields interpretable abstract actions that reflect the underlying reward structure.

By Oussama Boussif, L\'ena N\'ehale Ezzine, Joseph D Viviano, Micha{\l} Koziarski, Moksh Jain, Esmeralda S. Whitammer, Emmanuel Bengio, Rim Assouel, Yoshua Bengio
arXiv AI
Jun 9

ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learning

arXiv:2505. 21457v2 Announce Type: replace-cross Abstract: Active vision, also known as active perception, refers to actively selecting where and how to look in order to gather task-relevant information.

By Muzhi Zhu, Hao Zhong, Canyu Zhao, Zongze Du, Mingyu Liu, Zheng Huang, Anzhou Li, Hao Chen, Cheng Zou, Jingdong Chen, Ming Yang, Chunhua Shen
arXiv AI
Sep 17

A Comprehensive Review of Generative Physical Artificial Intelligence

The paper surveys Generative Physical Artificial Intelligence (GPAI), a field where large foundation models are integrated with physical robots. It introduces a taxonomy of five approaches—Robot Foundation Models, Vision‑Language Action models, Large Behavior Models, Diffusion Policy Models, and World Foundation Models—and discusses how they complement each other across domains such as autonomous vehicles, industrial automation, healthcare robotics, and humanoid systems. The review highlights performance gains, data‑efficient learning, sim‑to‑real transfer, edge‑compatible architectures, and safety frameworks as key research directions.

By Satyam Gaba, Krutiksinh Rana, Siva Sai, Vinay Chamola, Dusit Niyato
arXiv Machine Learning
Aug 11

V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control

arXiv:2608. 07870v1 Announce Type: new Abstract: Improving sample efficiency remains a core challenge in reinforcement learning (RL), especially in real-world settings like robotics, where data collection is costly.

By Donghu Kim, Youngdo Lee, Hojoon Lee, Johan Obando-Ceron, Byungkun Lee, Aaron Courville, Pablo Samuel Castro, Jaegul Choo, Clare Lyle