← Back to all news
arXiv AI By Lucas Resck, Jingyi Sun, Qianli Wang, Isabelle Augenstein, Anna Korhonen

The Reliance Hypothesis: Chain-of-Thought Faithfulness Rises as Language Resource Level Falls

Read the original on arXiv AI →

The paper investigates how Chain-of-Thought (CoT) faithfulness varies with language resource level and task type. Using MMMLU multiple-choice questions in eight languages, it finds that CoT faithfulness increases as resource level decreases for knowledge-intensive tasks but not for reasoning-intensive ones. The authors propose the Reliance Hypothesis, suggesting that models rely more on reasoning when they lack recall, especially in lower-resource languages, and note that model confidence partly explains this effect.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Oct 5

Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability

The paper investigates how training large language models to use fewer tokens in chain-of-thought (CoT) reasoning impacts the faithfulness and monitorability of the generated explanations. Three efficiency methods—fixed generation budget, per-example length target, and group-relative length reward—were applied during fine‑tuning, and the resulting models were evaluated on how well their CoT reflects decision processes and whether it signals changes due to input interventions. Results show that while faithfulness generally decreases because models become less consistent, monitorability remains relatively robust, with models still indicating the influence of input changes even when CoT is shortened.

By Samuel Lewis-Lim, Xingwei Tan, Mario Sanger, Zhixue Zhao, Nikolaos Aletras
llmsfine-tuning
More like this →