arXiv AI By Xinqi Zhang

NormWorlds-CF: Solver-Verified Counterfactual Normative Reasoning with Metamorphic-Relation GRPO

Read the original on arXiv AI →

arXiv:2607. 03957v1 Announce Type: cross Abstract: Language models can reach the right normative verdict for the wrong reason.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
Sep 7

ConsensusBench: Benchmark of Consensus Nodes for LLM Reasoning via Outcome Reward Densifying

ConsensusBench is a new dataset that supplies rule‑based process‑level signals for large language model reasoning. It identifies key intermediate conclusions—called Consensus Nodes—by filtering correct trajectories and clustering semantically equivalent statements. By incorporating a process reward derived from these nodes into GRPO‑style reinforcement learning, the authors create ConsensusPR, which reduces reward sparsity and improves performance on benchmarks such as AIME, GSM8K, and MATH‑500.

By Shi-Qi Yan, Chao-Hong Tan, Qian Chen, Wen Wang, Xiangang Li, Zhen-Hua Ling
Hugging Face Trending Papers
5d ago

RGDT-Bench: Benchmarking LLM Reasoning for Rule-Governed Decisions and Their Justifications

RGDT-Bench is a new benchmark that evaluates large language models on Rule‑Governed Decision Tasks, where models must apply external rules to facts, justify decisions, and provide checkable justifications. The benchmark offers 202.1K condition‑level supervision slots across four task tracks and eight task‑probe combinations, and it labels warrant completeness through label‑blind extraction and deterministic checks. Evaluation shows that among correct responses, 40.2% of warrants are incomplete, and existing evaluators struggle to detect this, prompting the authors to train a reward model that improves AUROC to 69.24% and outperforms outcome‑supervised baselines.

arXiv Computation and Language
Aug 27

AutoVerifier: Residual-Guided Non-Parametric Optimization for Reference-Based Answer Verification

AutoVerifier is a residual‑guided, non‑parametric optimization framework designed to improve reference‑based answer verification. It learns verifier inductive biases from recurring errors, records them as rule cards, and promotes them to code modules or prompt guidance only after replay validation ensures no regressions. Experiments on four verifier benchmarks show that AutoVerifier surpasses state‑of‑the‑art verifiers by a large margin.

By Zebei Zhao, Zhihao Shi, Minqi Shi