arXiv Computation and Language By Nayoung Kim, Mickey Mancenido, Huan Liu

Adaptive Triggering for Bias Correction in LLM Reasoning

Read the original on arXiv Computation and Language →

The paper introduces an adaptive triggering mechanism for bias correction in large language model (LLM) reasoning. By framing bias intervention as an online change‑point detection problem, the authors update a CUSUM statistic at each step using either a white‑box next‑token probability signal or a black‑box LLM judge signal, and inject corrective prompts only when the accumulated evidence exceeds a calibrated threshold. Experiments on gpt‑4o‑mini and six open‑weight models show that adaptive black‑box triggering restores most of the accuracy lost by fixed‑interval interventions while reducing the number of corrections, whereas the white‑box signal improves ambiguous‑item accuracy but can hurt disambiguated‑item accuracy due to difficulty distinguishing stereotype reliance from correct evidence.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Oct 31

The Anatomy of Socio-Demographics in Pluralistic Offensiveness Modeling: When and Where It Helps, and the Role of Reasoning

The study investigates how socio-demographic data can improve pluralistic offensiveness modeling. It finds that demographic information yields modest, inconsistent gains for individual predictions but clearer benefits at group and population levels due to aggregation. By explicitly reasoning about baseline judgments and demographic-specific deviations, the authors show that both components improve predictions, and that reasoning outperforms simple conditioning on demographics.

By Yifan Wang, Leixin Zhang, Jinyi Mu, Yu Wang, Mayank Jobanputra, Isabel Valera, Vera Demberg