arXiv AI
Jun 19
Can In-Context Learning Support Intrinsic Curiosity?
arXiv:2606. 19476v1 Announce Type: cross Abstract: Effective machine learning depends not only on how we model data, but also on what data we choose to collect.
Efficient Exploration Is Enough
Related stories
arXiv AI
Aug 26
Illuminating the Three Dogmas of Reinforcement Learning under Evolutionary Light
arXiv:2507.11482v5 Announce Type: replace Abstract: Artificial learning systems are graduating from passive learners to increasingly autonomous agents, lending pragmatic urgency to the question of wh...
arXiv AI
Jun 9
ASH: Agents that Self-Hone via Embodied Learning
arXiv:2605. 14211v3 Announce Type: replace Abstract: Long-horizon embodied tasks remain a fundamental challenge in AI, as current methods rely on hand-engineered rewards or action-labeled demonstrations, neither of which scales.
Hugging Face Trending Papers
Jun 17
Can In-Context Learning Support Intrinsic Curiosity?
Effective machine learning depends not only on how we model data, but also on what data we choose to collect. While large sequence models have revolutionized data modeling, the problem of automated data selection, or "intrinsic curiosity", remains a significant challenge.
arXiv AI
Aug 3
Explore Beyond the Boundary Using Entropic Information
arXiv:2607. 29419v1 Announce Type: cross Abstract: In reinforcement learning, exploration with sparse and delayed rewards presents a significant challenge due to the limited feedback available for guiding the learning process.
arXiv Machine Learning
Jun 17
EnvRL: Learn from Environment Dynamics in Agentic Reinforcement Learning
arXiv:2606. 17680v1 Announce Type: new Abstract: Reinforcement learning (RL) has emerged as a powerful paradigm for training Large Language Models (LLMs) as agents.
arXiv AI
Sep 15
RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments
arXiv:2609.15364v1 Announce Type: new Abstract: Digital agents must often adapt to new environments whose interfaces, tools, and failure modes are not fully captured by pretrained models. We introduc...
arXiv Machine Learning
4d ago
ELEMENT: Episodic and Lifelong Exploration via Maximum Entropy
The paper introduces ELEMENT, a framework that combines episodic and lifelong entropy maximization to drive reward-free exploration in reinforcement learning. It addresses two key limitations of existing entropy-based methods: the vanishing intrinsic reward after a state is visited and the computational cost of estimating entropy over large datasets. ELEMENT achieves this by deriving an average episodic state entropy reward and employing a k‑NN graph‑based estimator for lifelong entropy, leading to superior state coverage and unsupervised pre‑training performance compared to current baselines.
arXiv Machine Learning
Jul 22
HERAKLES: Hierarchical Skill Compilation for Open-ended LLM Agents
arXiv:2508. 14751v2 Announce Type: replace Abstract: We study goal-conditioned reinforcement learning in partially observable environments with sparse rewards and large, structured goal spaces.
Hugging Face Trending Papers
Aug 3
Quo Vadis, World Modeling?
Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to parallelize. World modeling offers a natural intermediate proxy that allows agents to query lower-cost, more controllable feedback before committing to real actions.
arXiv AI
Jun 26
Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning
arXiv:2606. 27330v1 Announce Type: cross Abstract: Multimodal web agents can assist humans in operating repetitive GUI tasks, where effective task planning is essential for decomposing complex tasks into executable actions.
arXiv AI
Jun 16
LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structure
arXiv:2606. 15306v1 Announce Type: cross Abstract: We envision continually learning agentic systems that become more useful over time: as they encounter sequences of related tasks, they should infer the hidden structure shared across those tasks and use it to improve future decisions.