arXiv Machine Learning By Esther Xin

What Should We Remove? Evaluating the Reliability and Costs of RLVR Data Decontamination

Read the original on arXiv Machine Learning →

The study audits 16 open RLVR math corpora, totaling 1,673,514 training items, against six benchmarks with 1,949 questions to assess the reliability and data‑loss costs of decontamination policies. Eight policies—based on exact, lexical, and semantic matching—were evaluated using 594 dual‑reviewed training‑benchmark pairs, with calibration and held‑out sets ensuring disjoint benchmark questions and training‑example families. Results show that at a cosine threshold of 0.80, 88% of sampled removals were false, and no semantic threshold in the tested grid met a 90% conservative‑precision target; however, the judge‑adjudicated policy achieved 98.1% resolved precision and 98.2% recall on held‑out corpora, with no confirmed false removals among six sampled removals.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 18

Model-Aware Data Cleaning for Tabular Foundation Models

The paper introduces L2C‑TFM, a reinforcement‑learning framework for cleaning tabular data before feeding it to Tabular Foundation Models (TFMs). It proposes a model‑aware reward that regularizes the Wasserstein distance between cleaned and dirty data, aiming to preserve distributional stability. Experiments on ten OpenML datasets show that while some reward designs fail, the model‑aware reward performs comparably to a random‑forest baseline and improves minority‑class macro‑F1 under class imbalance, and a policy trained on one dataset can transfer to others.

By Laure Berti-Equille
arXiv Computation and Language
Sep 17

English Word Sense Disambiguation in 2026: When the Labels Become the Bottleneck

The paper reports that in English all‑words word sense disambiguation (WSD), the scarcity of high‑quality labels—not the models—has become the limiting factor. The authors introduce lexEN, a human‑adjudicated correction layer over the Maru2022 ALL_NEW benchmark, and SenseBench, a living leaderboard for LLM WSD evaluation. They show that frontier large language models reach about 95 % accuracy on lexEN‑v1, that relabeling corpora with these models improves downstream systems, and that fine‑grained WordNet senses are often ill‑posed, with coarsening improving both annotator agreement and model performance. "whyItMatters":"The study highlights that improving label quality and managing annotation costs are now the critical challenges for advancing WSD performance, as model accuracy is already near its theoretical ceiling."

By Vassili Philippov, Amro Salman, Dmitrii Andreev, Penny Hands, Emil Kaiumov, Pavel Katunin, Anton Nikolaev