Hugging Face Trending Papers

Two Routes to Interoceptive Prioritisation: Dissociating Likelihood Precision and Preference Reweighting in Active Inference

The paper investigates how an embodied agent can prioritize competing bodily needs using active inference. It compares two strategies: increasing the precision of information about an urgent need and reweighting preferences for outcomes that relieve that need, both individually and combined, within a foraging gridworld with lethal needs. The study finds that precision improves survival and sharpens interoceptive beliefs, while preference reweighting keeps states away from lethal thresholds and alters the agent’s learned body model, with both interventions positively interacting to enhance survival across varied layouts.

arXiv AI
Oct 15

Two Routes to Interoceptive Prioritisation: Dissociating Likelihood Precision and Preference Reweighting in Active Inference

arXiv:2610.18617v1 Announce Type: new Abstract: An embodied agent must prioritise among competing bodily needs. In active inference, it can respond to an urgent need by increasing the precision of in...

By St John Grimbly, Nicolas Kuske, Evert A. Boonstra, Charel van Hoof, Rowan Hodson, Benjamin Rosman, Ryan Smith, Mark Solms, Jonathan P. Shock
arXiv AI
1d ago

Satisficing as competitive Bayesian weighting: a minimal model of goal-directed choice under an unattained target

The paper introduces Risk‑Sensitive Satisficing (RS), a bandit learning rule that evaluates actions based on their past frequency and their surplus or shortfall relative to an aspiration level. RS can be reformulated as Attention Competitive Bayes (ACB), a Bayesian‑like estimator where the aspiration level serves as a prior mean and the limited number of trials limits how strongly evidence can override this prior. ACB predicts that unchosen actions gradually revert toward the aspiration level (pseudo‑forgetting) and that when the aspiration is unattainable, exploration never fully settles, reducing regret in simulations.

By Moto Shinriki, Yu Kono, Tatsuji Takahashi
arXiv AI
Oct 12

EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

EmbodiedCLBench is the first benchmark designed to evaluate continual learning in embodied simulation environments, focusing on self‑evolving agents. The benchmark uses compositional generalization to test whether agents can learn basic tasks and then recombine those skills to solve more complex, unseen tasks. Experiments across various agent harnesses and learning methods reveal that while basic task experience improves performance on advanced tasks, this benefit does not scale with more learning samples and current agents fail to extract additional useful information.

By Jie Huang, Yanan Chen, Ruixun Liu, Kaichen He, Xinyi He, Rui Huang, Zilong Zheng, Zhenliang Zhang, Yiwu Zhong
arXiv AI
Oct 26

Effectiveness of Curriculum Learning Depends on Reward Sparsity and Competing Optima

The paper investigates how curriculum learning affects reinforcement learning in a minimal policy learning model. It shows that when rewards are dense, curricula offer only marginal benefits, but when rewards are sparse, curricula become essential for learning to occur. The study also highlights that competing objectives—minimizing effort versus maximizing reward—create distinct optima that curricula can help navigate by reducing reward sparsity and reshaping the reward landscape.

By John J. Vastola, Ann Huang, Satpreet H. Singh, Samuel J. Gershman, Kanaka Rajan
arXiv AI
Oct 21

A latent control model for realistic rodent motion

The paper introduces SCAMPER, a system that trains a virtual rat model to exhibit realistic movements during both goal-directed tasks and random exploration. SCAMPER employs a variational architecture with two priors—a motion prior for control and a behavior prior for exploration—to generate natural behavior and effectively exploit task structure. The system can learn from sparse rewards, enabling realistic modeling of sparse-reward tasks used in experimental neuroscience.

By Aidan Sirbu, Charles Y. Zhang, Yuanjia Yang, Bence P. \"Olveczky, Talmo D. Pereira, Blake A. Richards