AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,743 stories · RSS feed

arXiv Machine Learning
Oct 8

Expected Sample Complexity in Multi-Armed Bandits

The paper introduces the expected sample complexity metric for stochastic multi‑armed bandits and analyzes it within a new framework called approximately correct in expectation (ACE). It demonstrates that ACE guarantees lead to almost sure convergence to the optimal expected reward, contrasts this with high‑probability guarantees, and shows how to translate ACE bounds into explicit expected regret bounds. The authors prove that deterministic algorithms cannot achieve favorable ACE bounds, propose an explore‑then‑ε‑greedy algorithm when ε is known, analyze Thompson sampling when ε is unknown, and provide nearly matching lower bounds that establish tightness and a performance separation between the two regimes.

By Nadav Sukenik, Nadav Merlis
arXiv Machine Learning
Oct 8

Autonomous Droplet Navigation via Model-Based Reinforcement Learning: Zero-Shot Transfer and Emergent Dynamics

The paper presents a robotic platform that enables closed‑loop autonomous navigation of liquid droplets on an open surface using model‑based reinforcement learning. A two‑axis tilting board with a silicone oil film moves the droplet while an overhead camera supplies real‑time feedback, and a policy is trained in only 50–150 physical episodes without simulation or analytical models. The system demonstrates zero‑shot transfer to unseen geometries, autonomously discovers an oscillatory depinning strategy to release stuck droplets, and completes the full training pipeline in under 90 minutes.

By Rajneesh Anand, Mayuresh V. Kothare
arXiv Machine Learning
Oct 8

Shared-Roadmap Generation and Evaluator for Multi-Agent Path Planning Using Heterogeneous Graph Neural Network

The paper introduces a scalable heterogeneous Graph Neural Network framework that automatically generates and evaluates shared roadmaps for multi‑agent path planning in continuous environments. By representing waypoints, agent locations, and task locations as distinct nodes, the GNN learns from expert solver trajectories to identify critical points and prune redundant connections, producing a compact, coordination‑aware roadmap. Experiments show the approach can reduce planning effort, achieving at least a 40% reduction in runtime and graph size for dense roadmaps.

By Brandon Ho, Nikola Rogers, Seung-Kyum Choi
arXiv Machine Learning
Oct 8

Kernel Autoresearch for Open-Ended Model Discovery

Kernel Autoresearch (Kernaut) is a new approach that treats kernel design as open‑ended model discovery, using coding agents to write kernel programs while construction contracts guarantee validity. The method maintains a quality‑diversity archive and novelty screening to encourage functionally distinct kernels, which are shown to generalize to unseen tasks and outperform meta‑learned deep kernels on black‑box optimization families. Additionally, kernels discovered from enzyme‑kinetic rate laws achieve lower error than tuned ARD and deep kernel baselines, and a human‑refined version further improves predictive accuracy and optimization regret.

By Richard Cornelius Suwandi, Feng Yin, Kevin Murphy
arXiv Machine Learning
Oct 8

CARE: Certifying Acceleration for Vision-Language-Action Inference

The paper introduces CARE, a method for certifying accelerated inference in vision‑language‑action models. CARE uses paired rollouts on a calibration set to guarantee that the risk of acceleration‑induced failure stays below a user‑specified budget, selecting the fastest certified accelerator or falling back to the reference policy. Experiments on LIBERO suites show that CARE achieves 9.0–10.8× speedups while preserving at least 85.8% of reference‑solved episodes with 95% confidence, and it outperforms non‑guaranteed selectors in both budget adherence and rollout efficiency.

By Rui Liu, Tong Zheng, Jindong Gu, Zhipeng Wang
arXiv Machine Learning
Oct 8

A Good Self-Teacher Meets the Student Where They Are: Joint On-Policy Learning and Teaching

The paper introduces Joint On-Policy Learning and Teaching (JOLT), a method that trains a single policy to act both as a privileged teacher and an unprivileged student. It derives a condition ensuring the teacher’s distillation update aligns positively with the student’s reward gradient, leading to a KL‑regularized teacher objective that matches the student’s current capabilities. Experiments show JOLT improves training efficiency and performance across various tasks, with additional gains when student rewards are incorporated.

By Randy Ardywibowo, Arnav Dalal, Jiantao Jiao
arXiv Machine Learning
Oct 8

CADFather: Autonomous CAD Reconstruction through Coordinated Tool Use

CADFather is an autonomous system that reconstructs editable CAD models from 3D meshes by coordinating vision‑language assistants, learned and algorithmic tools, and numerical optimization. It evaluates and refines candidate CAD programs, maintaining alternatives for each part and preserving the best valid result throughout reconstruction. The system uses pretrained models without additional training and is evaluated on multiple benchmark datasets for reconstruction quality and execution validity.

By Gennadiy Savrasov, Maksim Elistratov, Nikita Gavrilov, Albert Garifullin, Oleg Pavlov, Soslan Kabisov, Vladimir Frolov, Anton Konushin, Andrey Kuznetsov, Dmitrii Zhemchuzhnikov
arXiv Machine Learning
Oct 8

SearchWorld: Spatial Value-Grounded Imagination for UAV Object Search via World Models

SearchWorld introduces a recurrent state‑space world model that couples explicit spatial memory with value‑guided imagination for UAV object search. The model maintains bird’s‑eye‑view exploration and obstacle memory, decodes a task‑aware spatial value layer, and uses a cognition‑action network to improve policy through imagined rollouts without a separate critic. Experiments on UAV‑ON show a 23.8% success rate, surpassing the best published agent (19.5%) and achieving 35.5% oracle success while remaining robust on unseen scenes.

By Yatai Ji, Zhengqiu Zhu, Yong Zhao, Yue Hu, Fanglong Yao, Chen Gao, Pengfei Zhu, Quanjun Yin
arXiv Machine Learning
Oct 8

Artificial intelligence pathways from weather to climate

arXiv:2610.09770v1 Announce Type: cross Abstract: Deep learning has made rapid advances in weather forecasting: autoregressive models trained on atmospheric reanalyses now rival dynamical models acro...

By Tom Beucler, J. David Neelin, Hui Su, Shivanshi Asthana, Chris Bretherton, Will Chapman, Costa Christopoulos, Spencer K. Clark, Aditya Grover, Ignacio Lopez-Gomez, Tapio Schneider, Adam Subel, Oliver Watt-Meyer
arXiv Machine Learning
Oct 8

Progress and Prospect of AI in ARPES Workflow

arXiv:2610.10140v1 Announce Type: cross Abstract: Artificial intelligence (AI) is becoming an increasingly useful tool across the experimental sciences, including angle-resolved photoemission spectro...

By Sandy Adhitia Ekahana, Aalok Tiwari, Pratik Saud, Aaron Bostwick, Chris Jozwiak, Eli Rotenberg, Jyoti Katoch
arXiv Machine Learning
Oct 8

RSIGym: A Flexible Environment for Recursive Self-Improvement

RSIGym is a new agent-native research environment built on Everything as a Service (EaaS) that exposes training, inference, rollout, evaluation, and sandbox execution through reusable services. It supports shared budget and permission controls for Data, Harness, and Joint improvement tracks, allowing agents to investigate individual interventions and jointly optimize data, training settings, and execution harnesses within the same environment. Using RSIGym, the Opus 5 model achieved the highest RSI-Index of 0.4809 across five benchmarks, improving performance on software engineering, terminal interaction, mathematics, scientific reasoning, and skill-based tasks.

By Fanqing Meng, Lingxiao Du, Haocheng Lu, Qiguang Chen, Ziqi Zhao, Zijian Wu, Jiayuan Zhuo, Mengkang Hu, Michael Qizhe Shieh
arXiv Machine Learning
Oct 8

Restricting the Model, Missing the System: Measurement and Accountability in Offensive AI Governance

arXiv:2605.09504v3 Announce Type: replace-cross Abstract: We show that the instruments used to measure AI offensive capability fail in two ways: (i) they overstate harm, and (ii) they credit the mode...

By Michael Alexander Riegler, Finn Schwall, Annika Willoch Olstad, Birk Sebastian Frostelid Torpmann-Hagen, Sushant Gautam, Klas H. Pettersen, Inga Str\"umke
arXiv Computation and Language
Oct 8

CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution

arXiv:2610.10426v1 Announce Type: new Abstract: Terminal-agent capability depends jointly on model weights and the runtime harness that formats prompts, binds tools, and handles error recovery. Exist...

By Jixuan Chen, Jiaxin Zhang, Qinyuan Ye, Yada Pruksachatkun, Haoxiang Zhang, Jingming Zhuo, Yifan Zhang, Yutong Dai, Juntao Tan, Xiangyu Peng, Silvio Savarese, Zeyuan Chen, Lianhui Qin, Chien-Sheng Wu