arXiv AI
Jun 4

Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance

arXiv:2606. 04970v1 Announce Type: cross Abstract: We envision a proactive multi-modal assistant system which gives users real-time step-by-step guidance on a procedural task, autonomously deciding \textit{when} to interrupt, and \textit{how} to coach.

By Kaustav Kundu, Ritvik Shrivastava, Maxim Arap, Nanshu Wang, Xianhui Zhu, Quintin Fettes, Gautam Tiwari, Parth Suresh, Th\'eo Moutakanni, Alejandro Castillejo Munoz, Allen Bolourchi, Pascale Fung, Pinar Donmez, Babak Damavandi, Anuj Kumar, Seungwhan Moon
Hugging Face Trending Papers
Jun 3

Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance

We envision a proactive multi-modal assistant system which gives users real-time step-by-step guidance on a procedural task, autonomously deciding \textit{when} to interrupt, and \textit{how} to coach. However, progress is limited by the absence of large-scale, cross-domain benchmarks that reflect realistic conditions, particularly the common case in which users deviate from the expected step sequence.

arXiv Computer Vision
Sep 3

Designing Versatile Samples for Learned Trajectory Scoring

The paper proposes a new training dataset that generates more informative positive and negative samples for trajectory scoring in autonomous driving. By perturbing logged human trajectories laterally toward the drivable boundary and longitudinally toward a leading vehicle, the dataset provides richer supervision than the planner’s default proposal pool. Using a transformer-based scorer trained on this dataset, the authors achieve improved EPDMS scores on two frozen planners, DiffusionDrive and MeanFuser, when evaluated on the NAVSIM navtrain dataset.

By Yaguang Li, Jiaru Zhang, Chuheng Wei, Can Cui, Ziran Wang
Hugging Face Trending Papers
Jun 25

LAMP: Lane-Aligned Motion Primitives for Feasible Trajectory Prediction

Motion forecasting is essential for autonomous driving systems to enable safe decision-making and planning in complex driving scenarios. While existing predictors excel at minimizing standard displacement errors, they often overlook the adherence to lane topology of multimodal predictions, particularly for lower-probability modes.