arXiv Computation and Language

When the Right Answer Is Missing: An Arithmetic-Dependent Rejection Bottleneck in Jev

arXiv AI
Sep 25

NumericJev: Jev-like LLM Numerical Decoding with Multiway Decision Trees

NumericJev introduces a training‑free numerical decoding algorithm that allows large language models with Jev‑like structured‑choice interfaces to output precise numerical values. The method refines a numerical range using a multiway decision tree, achieving lower mean absolute error than direct selection from a candidate list. Experiments on an arithmetic benchmark show a 2.93 percentage‑point improvement, and a historical‑index study reports a 4.58% mean relative recall error with zero readout error when the value is supplied.

By Weiwei Ye, Hangchen Liu, Renhe Jiang
Hugging Face Trending Papers
Jun 2

Testing LLM Arithmetic Reasoning Generalization with Automatic Numeric-Remapping Attacks

Large language models achieve strong performance on arithmetic reasoning benchmarks, and one common response to arithmetic brittleness is to delegate computation to code. Yet models are still often used in settings where they must reason directly from natural language, and trustworthy models should solve small-number arithmetic word problems without external tools.

arXiv Machine Learning
Jul 30

Lottery Tickets Are Not Deployment Tickets

arXiv:2607. 27031v1 Announce Type: new Abstract: Reports on how sparsification, compression, and lottery tickets change model behavior have been mixed in the prior literature, with beneficial effects observed in some studies and adverse effects in others.

By Bum Jun Kim
arXiv AI
Aug 20

Selection, Recombination, or a Fresh Solve? A Candidate-Free Control for Single-Pass Test-Time Aggregation

The paper investigates whether providing candidate solutions during test‑time aggregation improves or harms accuracy compared to a fresh solve that does not use any candidates. Using Qwen3‑4B on AIME‑2025 and HMMT‑2025, the authors find that conditioning on multiple correct candidates boosts accuracy (+0.290), while conditioning on an all‑wrong candidate pool reduces accuracy (−0.123); the effect for a single correct candidate remains unclear. The study also explores structured interventions and placebo controls, but the underlying mechanisms of these effects are not resolved.

By Guiv Farmanfarmaian
arXiv AI
Jun 16

Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning

arXiv:2606. 15972v1 Announce Type: cross Abstract: With large language models (LLMs) increasingly applied to mathematical reasoning, formal proof assistants such as Lean can be leveraged to verify reasoning outputs with machine-checkable rigor, enabling use cases such as answer selection in test-time scaling with K sampled candidate answers.

By Ji Feng, Zhouxing Shi