arXiv AI

Building World Models from Intrinsic Motivation

arXiv Machine Learning
Oct 28

Multi-Horizon Future Discovery for Physics-Informed Exploration

The paper introduces Hamiltonian Temporal Contrastive Curiosity (HTC²), a method that combines multi‑horizon temporal representation learning with Hamiltonian phase‑space structure to guide exploration in physical control environments. HTC² uses a horizon‑conditioned contrastive critic to learn relationships between future state pairs within an episode, and the resulting representation distance serves as an intrinsic reward. The reward is further modulated by bounded multi‑step Hamiltonian variation, and the framework is integrated with Soft Actor‑Critic and Proximal Policy Optimization, evaluated on six DeepMind Control Suite tasks against several baseline curiosity methods.

By Shuwei Wang, Qiang Guan, Brian Qiu, Haoxiang Huang, Haoxi Wang, Chenyu Li, Bo Xu, Sen Cui
arXiv AI
Aug 19

Towards Zero-Shot Task Transfer with Neurosymbolic World Models

The paper introduces a neurosymbolic world model that separates observation reconstruction from reward prediction, enabling the model to adapt zero‑shot to new reward functions defined over a shared symbolic state space. This approach addresses the task‑dependency of traditional neural world models, which learn latent representations tied to specific training tasks. Experiments show that the neurosymbolic formulation generalises more strongly than purely neural methods.

By Isidoro Tamassia, Lennert De Smet, Giuseppe Marra
arXiv AI
Oct 27

Intrinsic Goals for Autonomous Agents: Hierarchical Exploration Captures Future Volitional Action in Drosophila

The study investigates how intrinsic motivation drives autonomous behavior in fruit flies by combining whole-brain recordings with a neuromechanical digital twin. It shows that a hierarchical policy selecting from low‑level motor primitives, trained with 20 intrinsic motivation algorithms, can reproduce fly locomotor statistics and internal representations of future actions. The DIAYN algorithm, which maximizes behavioral entropy and sensory separability, best matches fly behavior and neural coding, capturing individual variability and interhemispheric kinematic encoding.

By Declan Kutscher, Reece Keller, Alyn Kirsch, Felix Pei, Aran Nayebi