Hugging Face Trending Papers

Equal-Budget Monte Carlo Tree Search versus Randomized-Restart List Scheduling for DAG Workflows: A Controlled Equal-Budget Computational Study

The study compares an equal‑budget Monte Carlo Tree Search (MCTS) scheduler with a randomized‑restart list scheduler for directed‑acyclic‑graph (DAG) workflows, ensuring all methods receive the same number of candidate schedules. Across 768 validated schedules, MCTS performed 2.88% worse than the restarts at a budget of 2048 evaluations, with the deficit persisting even when the selection rule was changed to textbook UCT. The results, limited to synthetic domains with 8–32 tasks and up to 2048 evaluations, suggest that simpler restart strategies can outperform MCTS in certain workflow structures.

arXiv AI
Oct 12

Equal-Budget Monte Carlo Tree Search versus Randomized-Restart List Scheduling for DAG Workflows: A Controlled Equal-Budget Computational Study

The study compares an MCTS scheduling method with a randomized‑restart list scheduler on DAG workflows under a strictly controlled equal‑budget protocol. With each arm given the same number of candidate schedules (2048), the MCTS method performed 2.88% worse than the restarts, a deficit that persists across various workflow densities and processor counts. Switching to a textbook UCT selection rule largely eliminates this gap, suggesting the original selection strategy was a key factor.

By Yuyu Zhang
arXiv AI
4d ago

Probe-and-Resume: When and How to Evaluate Agent Execution

The paper investigates the use of test‑time search, specifically Monte Carlo tree search (MCTS), to improve agent performance in terminal‑based computer‑use environments. It finds that conventional MCTS does not significantly boost task success due to limited critic information and poor intermediate state evaluation. The authors propose a new strategy called Probe‑and‑Resume, where a critic is invoked only when the agent believes it has finished, and it is given read, write, and execute access to a forked copy of the environment to probe hidden state. This approach raises success rates by 8.4 percentage points over standard MCTS and nearly matches a more expensive Codex CLI agent.

By Jiakai Xu, Tiancheng Ge, Tujie Guan, Yusheng Li, Rohan Timmaraju, Eugene Wu, Kostis Kaffes
arXiv AI
Sep 1

Moving the Mean Toward the Known Good, Not Beyond It: What Inference-Time Interventions and Weight Consolidation Buy in Open-Ended Generation

The study investigates how inference‑time interventions and weight consolidation affect open‑ended generation in an online bin‑packing task. By iteratively generating, verifying, selecting, and consolidating with LoRA, the model’s outputs shift toward higher value, reducing excess by 1.7 points and outperforming random consolidation by 3.1 points. Across three independent runs, the mean performance remained consistent, and the best candidates converged to the classic heuristic’s level without exceeding it, while consolidation also lowered the proportion of better‑than‑classic candidates but increased their absolute number.

By Roberto I. Ono Filho
arXiv Computation and Language
Oct 12

PreSTO: Predictive Subtree Prefetching for Fast LLM Power Sampling

PreSTO introduces Predictive SubTree Prefetching to accelerate PowerMH, a power sampling method for large language models. By prefetching future proposals in a tree of accept/reject decisions and using a predictive traversal rule, PreSTO maintains the same Metropolis–Hastings transition kernel while reducing model calls. Experiments on seven datasets and five base LLMs show median speedups of 1.71×, 1.91×, and 2.33× for PowerMH, EntropyCut, and MultiTryMH, respectively, with fewer and shorter model calls.

By Nan Jiang, Panagiotis Theodoropoulos, Wei Deng
arXiv AI
Sep 24

Bounded Loops: Pre-Run Spend Bounds, Proved Termination, and Verified Completion for Agent Harnesses

The paper introduces a formal framework for agent harnesses that guarantees termination, prevents drift, and enforces spend limits through bounded loops, gates, and repair relations. It proves that these guarantees hold even with repair budgets and demonstrates the effectiveness of the system by identifying vacuous gates and achieving low false‑accept rates in a 69‑loop catalogue. The authors provide an instrumented implementation and a held‑out mutant corpus to validate gate correctness.

By Varun Pratap Bhardwaj, Garima Singh, Arun Pratap Bhardwaj
arXiv Machine Learning
Sep 17

Temperon: Full-Time SAM Quality at a Third Less Wall-Clock

The paper introduces Temperon, a training strategy that uses plain SGD for the first 43% of the epoch budget and then hands off to a SAM‑wrapped Muon refiner for the remaining training. On datasets such as CIFAR‑10/100, SVHN, and Tiny ImageNet, Temperon achieves the same or better accuracy as full‑time SAM while reaching key performance targets faster and at lower cost. Ablation studies show that the Muon refiner contributes the majority of the performance gain, while the initial SGD explorer and its restarts add negligible benefit.

By Stamatis Mastromichalakis