arXiv AI

DeciCAD: Harness-Grounded Learning of Action Policies for CAD Agents

DeciCAD introduces a domain‑native harness for CAD agents that defines semantic CAD actions, decision‑oriented observations, environment feedback, and persistent state transitions. Using this harness, the authors develop a learning pipeline that extracts causal decision supervision from interaction trajectories and refines the policy through supervised fine‑tuning and geometry‑grounded online reinforcement learning. Across four CAD benchmarks, DeciCAD outperforms a general‑purpose coding harness, achieving higher F1 and IoU scores while reducing model‑output tokens by 45–88% and improving geometry availability from 66.5% to 73.5%.

arXiv AI
Jul 1

Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modeling

arXiv:2606. 31252v1 Announce Type: new Abstract: Large language models can write plausible CAD scripts, but reliable industrial CAD modeling requires more than syntactically valid code: every feature, placement, and assembly relation must be accepted by an exact geometric kernel while remaining editable as parametric boundary representation geometry.

By Fumin Liu, Haoyu Zhou, Fei Hao, Lin Yang
arXiv AI
Oct 16

CoDA: Co-Evolution of Data Engines and Action Policies

CoDA is a framework that lets a simulation data engine and an action policy evolve together using a shared memory of environment construction, policy failures, and learning progress. The memory stores validated diagnoses from a vision‑language critic, which are turned into generation programs that recreate challenging scenarios and training programs that help the policy improve. Using this approach, CoDA boosts out‑of‑distribution success on several manipulation tasks, raising success rates from 5.3 % to 27.6 % and achieving up to 84 % success on LIBERO‑Pro under perturbations.

By Tianjiao Yu, Zhilin Ou, Yifan Shen, Xinzhuo Li, Yuanzhe Liu, Onkar Kishor Susladkar, Fan Wang, Ismini Lourentzou
arXiv AI
Sep 28

SUN: Agentic Robot Policy Learning with Persistent Task Programs

The paper introduces SUN (Semantically UNified) Programs, typed executables that translate grounded relations into optimal control objectives, satisfaction predicates, and learning rewards. Using the Kuafu harness, a foundation model orchestrates scene preparation, verification, residual reinforcement learning, and data generation, repairing candidate programs and calibrating reward weights. Across nine multi‑stage manipulation tasks, Kuafu achieves an 82.03% success rate, outperforms learned baselines, generates demonstrations 10.57× faster than human teleoperation, and transfers zero‑shot to physical Franka and Kinova robots.

By Weiqi Wang, Zhi Li, Yudong Lei, David Martinez, Xiaofeng Gao, Yuxin Jiang, Chenfanfu Jiang, Yingnian Wu, Demetri Terzopoulos, Ran Gong
arXiv AI
Oct 15

HarnessMDP: Learning to Control LLM Agent Harnesses with Offline Reinforcement Learning

HarnessMDP is a learning-based framework that treats the execution harness of large language model agents as a learnable control layer. By formulating agent execution as a finite-horizon Markov decision process, the harness learns to select structural execution actions from the evolving agent state, using offline reinforcement learning from collected trajectories. Experiments on coding tasks, tau-bench, AgentBench, and other evaluation settings show that HarnessMDP consistently improves execution behavior and final task performance over baseline harnesses.

By Haiwen Yi, Xinyuan Song
arXiv Machine Learning
Aug 7

EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents

arXiv:2608. 05446v1 Announce Type: new Abstract: Long-horizon LLM agents increasingly rely on external execution support to maintain state, track progress, invoke tools, verify outcomes, and reuse experience across interactions.

By Xuying Ning, Dongqi Fu, Tianxin Wei, Hanqing Zeng, Yuanchen Bei, Bingxuan Li, Zihao Li, Qifan Wang, Xiang Shen, Yifan Wu, Jiayi Liu, Hong Li, Yinglong Xia, Xiangjun Fan, Hanghang Tong, Jingrui He