Hugging Face Trending Papers
Sep 10

Beyond Confidence: Stability-Aware Test-Time Adaptation for LLM Reasoning

The paper introduces TASCO, a test‑time adaptation method that improves Large Language Model reasoning by optimizing stability‑aware confidence. It keeps the LLM frozen and uses a lightweight task‑level prefix, applying Random Perturbation for distributional stability and Sharpness‑Aware Perturbation for worst‑case sensitivity. Experiments show enhanced reasoning accuracy and token efficiency across various LLMs and benchmarks, while preserving stable confidence without over‑concentrating predictions.

arXiv AI
Sep 12

Beyond Confidence: Stability-Aware Test-Time Adaptation for LLM Reasoning

The paper introduces TASCO, a test‑time adaptation framework that enhances Large Language Model reasoning by incorporating local stability into confidence‑based adaptation while keeping the model frozen. TASCO optimizes a lightweight task‑level prefix using two perturbation strategies—Random Perturbation for distributional stability and Sharpness‑Aware Perturbation for worst‑case sensitivity—to ensure that high confidence aligns with correctness. Experiments show that TASCO improves reasoning accuracy and token efficiency across various LLMs and benchmarks, and behavioral analyses confirm that it maintains stable confidence without over‑concentrating the predictive distribution.

By Bincheng Gu, Min Gao, Zongwei Wang, Yibing Bai, Yulan He, Junliang Yu
arXiv Machine Learning
Jun 16

Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification

arXiv:2601. 22642v2 Announce Type: replace Abstract: Large Language Models (LLMs) show remarkable capabilities, yet their stochastic next-token prediction creates logical inconsistencies and reward hacking that formal symbolic systems avoid.

By Chuxue Cao, Jinluan Yang, Haoran Li, Kunhao Pan, Zijian Zhao, Zhengyu Chen, Yuchen Tian, Lijun Wu, Conghui He, Sirui Han, Yike Guo