arXiv Computation and Language October 16, 2026 By Xiaomeng Hu, Jiaqi Hu, Hao Chen, Qi Zhang, Zhanming Shen, Wentao Ye, Junbo Zhao

Reasoning Error from Known Fact: Step-Level Self-Consistency Group Relative Policy Optimization for LLMs

Read the original on arXiv Computation and Language →

The paper introduces Step-level Self-Consistency Group Relative Policy Optimization (SSC‑GRPO), a method that assigns rewards to individual steps in a reasoning trace by evaluating self‑consistency across multiple rollouts. It targets Context‑Sensitive Factual Hallucinations—errors that arise when a model has the correct knowledge but produces false statements due to contextual interference. SSC‑GRPO outperforms previous approaches on mathematical reasoning benchmarks and hallucination leaderboards, offering a new way to detect and reduce hallucinations in large language model reasoning.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language

Aug 25

GRACE: Step-Level Benchmark for Faithful Reasoning over Context

GRACE is a step‑level benchmark for evaluating the faithfulness of chain‑of‑thought reasoning over context. It provides human annotations for each step in CoT traces from 10 models across 4 datasets, labeling faithfulness, error category, and natural‑language explanations. The benchmark introduces a data‑driven taxonomy that splits errors into GRACE‑Inference (deductive) and GRACE‑Grounding (factual) tracks, each with four categories, and demonstrates that incorporating step‑level faithfulness signals can improve downstream accuracy and reasoning reliability.

By Hoang Pham, Dong Le, Anh Tuan Luu

llms nlp reinforcement-learning benchmarks safety

arXiv AI

Jun 15

ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning

arXiv:2606. 14697v1 Announce Type: cross Abstract: Building trustworthy medical multimodal large language models (MLLMs) is critical for reliable clinical decision support.

By Sicheng Yang, Hangjie Yuan, Wenjun Zhang, Jinwang Wang, Yichen Qian, Weihua Chen, Fan Wang, Lei Zhu

llms fine-tuning multimodal benchmarks safety

arXiv AI

Jul 21

Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering

arXiv:2607. 18100v1 Announce Type: new Abstract: Extended reasoning has become standard for frontier Large Language Models (LLMs), yet the trajectories these models produce remain largely uncontrollable.

By Sheldon Yu, Tong Yu, Xunyi Jiang, Rohan Surana, Gagan Mundada, Sungchul Kim, Lina Yao, Julian McAuley, Junda Wu

llms

arXiv Machine Learning

Jun 4

Reasoning Shift: How Context Silently Shortens LLM Reasoning

arXiv:2604. 01161v2 Announce Type: replace Abstract: Large language models (LLMs) exhibiting test-time scaling behavior, such as extended reasoning traces and self-verification, have demonstrated remarkable performance on complex, long-term reasoning tasks.

By Gleb Rodionov, Roman Garipov, George Yakushev

llms agents fine-tuning

arXiv Machine Learning

Jul 27

Reasoning Denoiser: Denoising Reasoning Traces for Hallucination Detection in Large Reasoning Models

arXiv:2607. 22098v1 Announce Type: cross Abstract: Large reasoning models (LRMs) generate long reasoning traces before producing final answers.

By Junlin Fang, Do Nguyen-Thanh, Xiaogang Xu, Zhen Fang, Sean Du

rag benchmarks safety

arXiv AI

Sep 21

LogicTrack: Auditing Reasoning Trajectories of Large Language Models with Formal Logic Solvers

arXiv:2609.21492v1 Announce Type: new Abstract: Chain-of-Thought (CoT) reasoning has been shown to improve the performance of large language models (LLMs), yet existing optimization methods largely r...

By Jingyu Hu, Shu Yang, Weiru Liu, Di Wang

llms fine-tuning benchmarks

One email a morning, machine-written

Related stories

GRACE: Step-Level Benchmark for Faithful Reasoning over Context

ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning

Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering

Reasoning Shift: How Context Silently Shortens LLM Reasoning

Reasoning Denoiser: Denoising Reasoning Traces for Hallucination Detection in Large Reasoning Models

LogicTrack: Auditing Reasoning Trajectories of Large Language Models with Formal Logic Solvers