LeRobot goes to driving school: World’s largest open-source self-driving dataset
Related stories
LeRobot Community Datasets: The “ImageNet” of Robotics — When and How?
Bringing Robotics AI to Embedded Platforms: Dataset Recording, VLA Fine‑Tuning, and On‑Device Optimizations
LeRobot v0.4.0: Supercharging OSS Robot Learning
Creating Impactful Autonomous Driving Datasets: A Strategic Guide from Research Gap to Benchmark
arXiv:2607. 00710v1 Announce Type: cross Abstract: Well-designed autonomous driving datasets have fundamentally shaped research progress, yet existing literature primarily describes what datasets contain rather than how to strategically design impactful ones.
TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving
arXiv:2602. 23499v4 Announce Type: replace-cross Abstract: Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable.
SSIL: Self-Supervised Imitation Learning for End-to-End Driving
arXiv:2308. 14329v4 Announce Type: replace-cross Abstract: In autonomous driving, the end-to-end (E2E) driving approach that predicts vehicle control signals directly from sensor data is rapidly gaining attention.
A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform
The paper reviews end‑to‑end autonomous driving (E2E‑AD) training, framing it as a Data‑Strategy‑Platform system. It surveys recent advances in data pipelines, learning paradigms, and training infrastructures, and discusses how these layers interact to influence model performance, robustness, and deployability. The authors highlight current limitations and propose a future vision that prioritizes data value, foundation‑driven generalization, and integrated training‑testing loops for more robust, scalable, and trustworthy autonomous driving systems.
End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems
arXiv:2610.01746v1 Announce Type: cross Abstract: Autonomous driving systems have become a central focus of intelligent transportation research, with End-to-End Learning and Modular Architectures off...
LeRobot v0.6.0: Imagine, Evaluate, Improve
Pictura: Perspective-View Self-Play at Scale for Driving
arXiv:2607. 26005v1 Announce Type: cross Abstract: Self-play in simulation produces robust driving policies at scale.
What Emerges and What Breaks in Self-Play Driving
The paper reports on training autonomous driving policies via self‑play, extending previous work by using Transformers and a real‑city high‑definition map. On CARLA and Waymo benchmarks, the resulting policies underperform compared to Gigaflow, with identified failure modes such as reward hacking at traffic lights and lack of incentive to stop at stop signs. The authors also analyze which traffic rules emerge from self‑play and confirm that reward conditioning produces diverse driving behaviors.