arXiv AI

Reward Machines for Signal Temporal Logic

arXiv:2608. 13625v1 Announce Type: new Abstract: Signal temporal logic (STL) provides a formal language for specifying real-time properties of real-valued observations, along with a quantitative robustness score for monitoring satisfaction.

arXiv Machine Learning

Sep 21

Efficient Bayes-Adaptive Reinforcement Learning with Temporal Logic Specifications

The paper introduces an end‑to‑end model‑based reinforcement learning algorithm that synthesises policies satisfying Linear Temporal Logic (LTL) specifications in unknown environments. It synchronises a Limit‑Deterministic Büchi Automaton (LDBA) with a Bayes‑Adaptive Markov Decision Process (BAMDP) and proposes a novel Bayes‑Adaptive Monte‑Carlo Planning (BAMCP) method for approximate Bayes‑optimal strategy synthesis. Experiments on finite and infinite‑horizon tasks show improved property satisfaction and sample efficiency compared to model‑free baselines, and ablation studies confirm the advantage of the new BAMCP over classical variants, including reduced task violations in cautious RL settings.

By Jonathan Hau, Alessandro Abate

reinforcement-learning benchmarks safety

arXiv AI

Jun 9

Neuro-Symbolic Injection of LTLf Constraints in Autoregressive Reinforcement Learning Policies

arXiv:2606. 08312v1 Announce Type: new Abstract: In this work we study offline reinforcement learning (RL) under temporally extended task constraints expressed in Linear Temporal Logic over finite traces (LTLf).

By Ashkan Ansarifard (Sapienza University of Rome), Matteo Mancanelli (Sapienza University of Rome), Elena Umili (Sapienza University of Rome), Fabio Patrizi (Sapienza University of Rome)

llms reinforcement-learning safety

arXiv AI

Sep 11

Reinforcement Learning with Temporal-Logic-Based Causal Diagrams

The paper introduces Temporal-Logic-based Causal Diagrams (TL-CDs) for reinforcement learning tasks that involve temporally extended goals. TL-CDs encode causal relationships among environmental properties, complementing deterministic finite automata that model rewards. By leveraging TL-CDs, the authors design an RL algorithm that can predict expected rewards early, leading to significantly reduced exploration and faster convergence to optimal policies.

By Yash Paliwal, Rajarshi Roy, Jean-Rapha\"el Gaglione, Nasim Baharisangari, Daniel Neider, Xiaoming Duan, Ufuk Topcu, Zhe Xu

agents reinforcement-learning

arXiv AI

Aug 17

Semantically Labelled Automata for Multi-Task Reinforcement Learning with LTL Instructions

arXiv:2602. 06746v2 Announce Type: replace Abstract: We study multi-task reinforcement learning (RL), a setting in which an agent learns a single, universal policy capable of generalising to arbitrary, possibly unseen tasks.

By Alessandro Abate, Giuseppe De Giacomo, Mathias Jackermeier, Jan Kret\'insk\'y, Maximilian Prokop, Christoph Weinhuber

rag agents reinforcement-learning benchmarks

arXiv AI

Aug 26

Topology-Guided Modular Actor-Critic Learning for Continuous Systems under Temporal Objectives

arXiv:2304.10041v2 Announce Type: replace Abstract: This work investigates formal policy synthesis for continuous-state stochastic dynamic systems subject to high-level specifications expressed in li...

By Lening Li, Zhentian Qian, Jianan Xia, Qiren Geng, Huasheng Zhang, Liang Hu, Qishuang Li, Junqiang Lou

reinforcement-learning efficiency

arXiv Machine Learning

Aug 18

Temporal Logic Guided Universal Task Representations for Reinforcement Learning

arXiv:2608. 15509v1 Announce Type: cross Abstract: Task guided agents demonstrate strong performance in a wide range of complex tasks.

By Hao Zhang, Zhangli Zhou, Zhen Kan

agents reinforcement-learning robotics

arXiv Machine Learning

Jun 4

Policy Improvement Reinforcement Learning

arXiv:2604. 00860v3 Announce Type: replace Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has become a central post-training paradigm for improving the reasoning capabilities of large language models.

By Huaiyang Wang, Xiaojie Li, Deqing Wang, Haoyi Zhou, Zixuan Huang, Yaodong Yang, Jianxin Li, Yikun Ban

llms reinforcement-learning benchmarks

arXiv Machine Learning

Aug 17

hint$^2$: Hierarchical World Models for Inference-Time Temporal Logic Guidance

arXiv:2608. 13678v1 Announce Type: cross Abstract: A central goal of robot learning is to enable robots to execute rich instructions specified at runtime.

By Moritz Zoellner, Anastasios Manganaris, Ahmed H. Qureshi, Rohan Paleja

diffusion robotics safety

arXiv AI

Jun 10

Bellman-Taylor Score Decoding for Markov Decision Processes with State-Dependent Feasible Action Sets

arXiv:2606. 10979v1 Announce Type: new Abstract: Many Markov decision processes (MDPs) in operations research have feasible actions that are state dependent and defined implicitly by various operational constraints.

By Yi Chen (Lucy), Rushuai Yang (Lucy), Qiang Chen (Lucy), Dongyan (Lucy), Huo

reinforcement-learning benchmarks

arXiv AI

Jul 14

Learning Linear Temporal Specifications from Demonstrations with Uncertainty

arXiv:2607. 10918v1 Announce Type: new Abstract: Learning temporal logic specifications from system demonstrations is essential for tasks such as formal verification and controller synthesis, especially in safety-critical domains.

By Parastou Fahim, Constantino Lagoa, R\^omulo Meira-G'oes

benchmarks safety

arXiv AI

4d ago

Video2STL: Grounding VLM-Generated Temporal Specifications for Robot Learning

arXiv:2609.37519v1 Announce Type: cross Abstract: Video-based policy learning is particularly promising, as it illustrates target behaviors without requiring action annotations or embodiment-matched...

By Merve Atasever, Keyan Azbijari, Cagan Bakirci, Bo-Ruei Huang, Tolga Izdas, Zahra Shahrooei, Richard Yang, Erdem Biyik, Jyotirmoy V. Deshmukh

llms reinforcement-learning robotics multimodal

arXiv AI

Jul 21

A Survey on the Verification of Reinforcement Learning Policies

arXiv:2607. 16210v1 Announce Type: new Abstract: Reinforcement learning (RL) is increasingly applied in complex, safety-critical domains, yet the lack of rigorous behavioral guarantees for neural network-based policies remains a major barrier to deployment.

By Luca Marzari, Ezio Bartocci, Enrico Marchesini

reinforcement-learning safety

Related stories