arXiv Machine Learning By Shuwei Wang, Qiang Guan, Brian Qiu, Haoxiang Huang, Haoxi Wang, Chenyu Li, Bo Xu, Sen Cui

Multi-Horizon Future Discovery for Physics-Informed Exploration

Read the original on arXiv Machine Learning →

The paper introduces Hamiltonian Temporal Contrastive Curiosity (HTC²), a method that combines multi‑horizon temporal representation learning with Hamiltonian phase‑space structure to guide exploration in physical control environments. HTC² uses a horizon‑conditioned contrastive critic to learn relationships between future state pairs within an episode, and the resulting representation distance serves as an intrinsic reward. The reward is further modulated by bounded multi‑step Hamiltonian variation, and the framework is integrated with Soft Actor‑Critic and Proximal Policy Optimization, evaluated on six DeepMind Control Suite tasks against several baseline curiosity methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Statistics ML
Oct 1

Learning to Plan from Random Exploration

arXiv:2609.38383v1 Announce Type: cross Abstract: Random exploration reveals how an environment can be traversed before a goal is specified. Can this experience support long-range planning without po...

By Deqian Kong, Guangyan Sun, Sheng Cheng, Sirui Xie, Bo Pang, Jianwen Xie, Tony Geng, Caiwen Ding, Ying Nian Wu