arXiv Machine Learning

DataCupid: Stable Matching Repair for Training Data Acquisition with Delayed Feedback

The paper introduces RLR, a stable matching repair method that reuses valid observations while respecting matching capacity and handling delayed, out‑of‑order evaluations. RLR combines sound outcome certificates with batched matching schedules to manage unequal sample deficits, achieving a sharp issue‑round bound and separate delay and evidence‑lifetime bounds. The authors also present RLR‑P, a variant that monitors issue‑order prefixes without altering the sampling plan, and demonstrate through simulations that it reduces mean capped update‑certification time compared to a width‑based baseline, albeit with higher oracle CPU cost.

arXiv AI
4d ago

Fix, Not Just Resample: Bounded Compiler-Guided Repair in Lean 4

The paper presents a bounded, online step-level repair module for Lean 4 that uses compiler error messages to fix rejected tactics instead of discarding them. By sampling up to $K$ candidate tactics and allowing at most $R$ repairs per step, the method improves solve rates over a sampling-only baseline, achieving up to a 32% relative gain and solving 82 additional theorems on a 1,990-theorem subset of the LeanDojo benchmark. The approach trades extra runtime for reachable proofs, with most benefit coming from early repair attempts and shallow tactic failures, and it successfully replicates on the Lean Workbook benchmark, nearly doubling its solve rate without regressions.

By Haotian Deng, Chris Farber, Sonal Narasimha, Samskrithi Sivakumar, Yexiang Xue
arXiv AI
Aug 5

BulkPR-Bench: Benchmarking Queue-Level Governance of Interacting Pull Requests

arXiv:2608. 02685v1 Announce Type: cross Abstract: Coding-agent benchmarks increasingly cover long-horizon, end-to-end, and interactive development, but typically retain one requested outcome or a fixed change sequence.

By Zetong Xiong, Qiao Zhao, Jun Zhang, Xueying Lyu, Zhi Li, Yixiang Tu, Xiaowen Yang, Yunjie Zhang, Yufeng Wang, Zhe Zhang, Kaize Yu, Hanwen Du, Zhongkai Sun, Zhuoxin Liu, Zekun Lin, Jianwen Yang, Ruining Chen, Ying Zhang, Tingxuan Pan, Ke Chen, Shubin Han, Chuanhao Sun, Yehua Yang
arXiv Machine Learning
Sep 4

Beyond Endpoint Scores: Time- and Capacity-Conditioned Evaluation of Continual Knowledge Updating

The paper argues that evaluating continual knowledge‑updating methods solely at a final checkpoint and a single adapter rank can be misleading. By fixing a periodic hierarchy and comparing it to cumulative replay on a 24‑month Wikidata stream, the authors show that the apparent best method changes depending on the evaluation month, replay LoRA rank, and query formulation. They recommend reporting performance trajectories and capacity sweeps, and only declaring a robust winner when the ranking remains stable across the evaluation region.

By Heejin Choi
Hugging Face Trending Papers
Jul 27

Certified Parallel-in-Time Sinkhorn for Dynamic Entropic Optimal Transport

Dynamic applications, including optimal-transport Flow Matching, repeatedly solve related entropic optimal transport problems, yet conventional distributed Sinkhorn processes frames sequentially and synchronizes after every iteration. We present TemporalSinkhorn, a parallel-in-time executor that batches future candidates and their repairs without making output accuracy speculative.