arXiv:2607. 16591v1 Announce Type: cross Abstract: The RLxF programme argues that learning signals should come from world feedback rather than from internal model proxies.
arXiv:2511. 02748v2 Announce Type: replace-cross Abstract: We argue that sixth-generation (6G) intelligence is not fluent token prediction but the capacity to imagine and choose -- to simulate future scenarios, weigh trade-offs, and act with calibrated uncertainty.
arXiv:2604. 26836v3 Announce Type: replace Abstract: Predictive safety filters (PSFs) leverage model predictive control to enforce constraint satisfaction during deep reinforcement learning (RL) exploration, yet their reliance on first-principles models or Gaussian processes limits scalability and broader applicability.
The paper introduces Dual-Frontier, a learning principle that determines when an agent should trust its world model for decision-making. It formalizes the failure-attribution problem as a counterfactual decomposition of return loss and shows that its components cannot be identified from passive interaction, even for finite-horizon planners. Dual-Frontier allows a model‑guided decision only when the predicted advantage exceeds a certified bound on decision‑relevant world‑model error; otherwise, the agent focuses on verifying the model. The authors provide theoretical guarantees, adaptive evidence reuse, and experimental validation on controlled and realistic benchmarks, demonstrating improved decision quality and reliability.
The article discusses how current world models, while achieving high predictive likelihood and visual fidelity, often fail to preserve the evidence needed for safe decision-making in embodied systems. It identifies three structural mismatches—likelihood versus risk, prediction versus intervention, and finite-horizon prediction versus accumulated consequences—and proposes the Risk‑Informed World Model (RIWM) as a decision‑centric framework. RIWM emphasizes consequences, intervention, epistemic uncertainty, and recoverability, integrating decision‑relevant representation, counterfactual reasoning, safety‑critical episodic memory, and runtime safety assurance to better support safety‑critical embodied systems.
arXiv:2607. 07252v1 Announce Type: new Abstract: Reinforcement learning (RL) enables the synthesis of control policies directly from data, making it highly appealing for complex cyber-physical systems (CPSs) and robotics.
RiskWorld is a risk‑aware world modeling framework that forecasts shared occupancy and selectively replaces planned trajectories in automated driving. It fuses spatial risk fields, temporal actor context, and visual bird’s‑eye‑view features, using flow‑guided evolution to transport occupancy and signed residuals to correct it. In open‑loop planning on nuScenes, RiskWorld achieves the lowest collision rate over a 3‑second horizon and the second‑best average L2 error, running at 11.5 FPS on a single NVIDIA RTX 4090.
arXiv:2407. 21359v2 Announce Type: replace-cross Abstract: Imagining potential outcomes of actions before execution helps agents make more informed decisions, a prospective thinking ability fundamental to human cognition.
arXiv:2609.22762v1 Announce Type: new Abstract: Generative world-action models (WAMs) jointly generate future video and vehicle actions, while their action branches remain primarily optimized by expe...
arXiv:2606. 16605v1 Announce Type: new Abstract: World models are widely used in robotic and agentic engineering control systems due to their ability to learn latent dynamics for planning and decision-making.
arXiv:2603. 18315v2 Announce Type: replace-cross Abstract: Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse collision signals, which fail to capture the rich contextual understanding required for safe driving and make unsafe exploration unavoidable in real-world settings.
arXiv:2607. 10362v1 Announce Type: new Abstract: Latent world models are trained to predict future states in a learned representation and are then deployed inside a planner that selects actions by simulating them forward.
arXiv:2608. 10403v1 Announce Type: new Abstract: Reinforcement learning (RL) has shown promising performance in autonomous driving, yet ensuring the safety of online RL policies remains challenging due to insufficient exposure to safety-critical driving scenes.