← Back to all news
arXiv Machine Learning By Haocheng Sun (Beijing University of Posts,Telecommunications), Mulai Tan (Air Force Engineering University)

BVR Sim: An Open and High-Throughput Environment for Heterogeneous Air-Combat Reinforcement Learning

Read the original on arXiv Machine Learning →

BVR Sim is an open‑source, Gymnasium‑style environment for heterogeneous air‑combat reinforcement learning, supporting multiple JSBSim aircraft models (F‑15, F‑16, F/A‑18, F‑22) with configurable weapons, sensors, and opponents. It offers a unified tactical action interface, interchangeable Python and accelerated C++ backends, entity‑oriented observations, compositional rewards, scripted opponents, replay and visualization, and adapters for multi‑agent learning frameworks. At a 0.4‑second decision interval, the C++ backend achieves 104 simulated seconds per wall‑clock second in 1‑vs‑1 and remains practical through 10‑vs‑10 scenarios, and a policy trained on the F‑16 transfers to four unseen aircraft with a 45.5% mean win rate after controller adaptation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv AI
Oct 28

Autonomous fixed-wing interception using reinforcement learning

The paper presents a fixed‑wing interceptor drone that uses a neural network trained with reinforcement learning to map monocular vision inputs directly to actuator commands. The policy, developed in a custom Python environment with proximal policy optimization, was tested against classical guidance controllers and demonstrated superior performance in simulation and successful interception of maneuvering fixed‑wing targets in real flight. This work illustrates the feasibility of AI‑driven autonomous control for long‑endurance interception missions.

By Daan van Hamersveld, Ewoud Smeur, Iurii Kriachko
agentsreinforcement-learning
More like this →
arXiv Machine Learning
Jul 21

Hierarchical Reinforcement Learning for Air Combat at DARPA's AlphaDogfight Trials

arXiv:2105. 00990v3 Announce Type: replace Abstract: Autonomous control in high-dimensional, continuous state spaces is a persistent and important challenge in the fields of robotics and artificial intelligence.

By Adrian P. Pope, Jaime S. Ide, Daria Micovic, Henry Diaz, David Rosenbluth, Lee Ritholtz, Jason C. Twedt, Thayne T. Walker, Kevin Alcedo, Daniel Javorsek
agentsreinforcement-learningrobotics
More like this →
arXiv AI
Oct 28

Curriculum-Driven Deep Reinforcement Learning for Autonomous Far-Range Rocket Landing

The paper introduces a curriculum-driven deep reinforcement learning framework for autonomous far-range rocket landing. It uses a three-stage curriculum, critic warm‑up, rehearsal to avoid catastrophic forgetting, and a high‑dimensional observation vector with a full 3×3 rotation matrix. The redesigned reward function bounds per‑step rewards and accumulates progress, yielding a 99.98% success rate over 100,000 episodes, far surpassing the baseline.

By Atin Chowdhury, Piyush Joshi
agentsreinforcement-learningbenchmarks
More like this →
arXiv Machine Learning
Aug 17

AgilePE: Autonomous UAV Pursuit-Evasion via Self-Play Reinforcement Learning

arXiv:2608. 14135v1 Announce Type: cross Abstract: Autonomous pursuit-evasion is a fundamental challenge for Unmanned Aerial Vehicles (UAVs), requiring rapid decision-making under tightly coupled dynamics and continuously changing opponent behaviors.

By Wenhao Tang, Tianyang Chen, Zhejun Cui, Boyuan An, Jiayu Chen, Ruize Zhang, Huidong Liu, Tianyue Wu, Qingmin Liao, Fei Gao, Yu Wang, Chao Yu
agentsreinforcement-learningrobotics
More like this →
arXiv Machine Learning
Sep 14

Curriculum-Based Adversarial Heterogeneous Agent Reinforcement Learning for Autonomous Quad-Copter Landing in Maritime Settings

The paper presents a curriculum‑based adversarial heterogeneous agent reinforcement learning (HARL‑AC) approach for autonomous quad‑copter landing on a ship deck in maritime settings. Using Heterogeneous‑Agent Proximal Policy Optimization (HAPPO) in NVIDIA Isaac Lab, the authors train a cooperative control policy that outperforms domain‑randomized baselines, achieving up to 97.5% success on in‑distribution sea states and higher median success and lower crash rates on out‑of‑distribution sea states. The adversarially trained policy also exhibits more cautious behavior, slightly increasing timeouts but improving safety in severe, unseen conditions.

By Allan Minh-Tam Nguyen, Sree Showrya Kotala, Stefan Banioi-Crijman, Kurt Driessens, Rico M\"ockel
agentsreinforcement-learningroboticsbenchmarkssafety
More like this →