arXiv Machine Learning June 30, 2026 By Matthew Vandergrift, Esraa Elelimy, Martha White

Position: RL Researchers Need to Distinguish Between Solving Simulators and Using Simulators as a Proxy

Read the original on arXiv Machine Learning →

arXiv:2606. 28433v1 Announce Type: new Abstract: One goal in reinforcement learning (RL) research is to understand general-purpose sequential decision-making, using benchmark simulators as a proxy for learning in deployment settings.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 13

One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RL

arXiv:2608. 12253v1 Announce Type: cross Abstract: Multi-agent reinforcement learning for human-AI interaction typically relies on a single large language model to simulate user behavior.

By Simon Yu, Nicholas Tomlin, Marwa Abdulhai, Ximing Lu, Derek Chong, Abe Hou, Dilara Soylu, Sergey Levine, Christopher D. Manning, Weiyan Shi

llms agents reinforcement-learning benchmarks

arXiv Machine Learning

Jul 14

Reinforcement Learning in the Real World: A Survey of Statistical Challenges and Future Directions

arXiv:2601. 15353v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has achieved remarkable success in real-world decision-making across diverse domains, including gaming, robotics, online advertising, public health, and natural language processing.

By Asim H. Gazi, Yongyi Guo, Daiqi Gao, Ziping Xu, Kelly W. Zhang, Susan A. Murphy

agents nlp reinforcement-learning robotics

arXiv AI

Jun 10

A Practical Recipe Towards Improving Sim-and-Real Correlation for VLA Evaluation

arXiv:2606. 10366v1 Announce Type: cross Abstract: Simulation has become an essential tool for evaluating and improving vision-language-action (VLA) policies, offering scalable, reproducible, and controllable alternatives to costly real-world robot evaluation.

By Shuo Wang, Hanyuan Xu, Yingdong Hu, Fanqi Lin, Yang Gao

robotics fine-tuning multimodal benchmarks safety

arXiv AI

Aug 6

Bi-Level Reinforcement Learning Pathway for Sim-to-Real Optimality

arXiv:2510. 17709v2 Announce Type: replace-cross Abstract: Training Reinforcement Learning (RL) policies using simulation models before deployment in real-world environments is a common strategy when real-world interaction is expensive.

By Akhil S Anand, Shambhuraj Sawant, Paavo Parmas, Jasper Hoffmann, Dirk Reinhardt, Sebastien Gros

reinforcement-learning robotics

arXiv AI

Jul 22

The Open Ant: A Robot Platform for Reinforcement Learning Research

arXiv:2607. 18488v1 Announce Type: cross Abstract: Reinforcement learning (RL) research has demonstrated success in both physical and simulated domains; however, the predominant methodology remains rooted in simulations.

By Elena Sorina Lupu, Patrick Spieler, Khurram Javed, Kris De Asis, John D. Martin, Martha Steenstrup, Joseph Modayil

reinforcement-learning robotics

arXiv AI

Jul 24

What Matters for Simulation to Online Reinforcement Learning on Real Robots

arXiv:2602. 20220v2 Announce Type: replace-cross Abstract: We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots.

By Yarden As, Dhruva Tirumala, Ren\'e Zurbr\"ugg, Chenhao Li, Stelian Coros, Andreas Krause, Markus Wulfmeier

reinforcement-learning robotics

Related stories

One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RL

Reinforcement Learning in the Real World: A Survey of Statistical Challenges and Future Directions

A Practical Recipe Towards Improving Sim-and-Real Correlation for VLA Evaluation

Bi-Level Reinforcement Learning Pathway for Sim-to-Real Optimality

The Open Ant: A Robot Platform for Reinforcement Learning Research

What Matters for Simulation to Online Reinforcement Learning on Real Robots