Not X, but When: Diagnosing a Mandarin LLM Writing Tic through Contextual Appropriateness
Read the original on arXiv Computation and Language →The paper investigates the Mandarin corrective construction "bushi X, ershi Y" (not X, but Y) in large language models, proposing a decision tree that classifies its use as substantive, optional, or defective based on contextual appropriateness. Across five commercial models, the construction appears 2.5 to 9.2 times more frequently than in human text, with 52.8% of annotated instances being optional—correct but unnecessary—while only 1.30% are defective. The study finds that reward models, LLM judges, and fine‑tuning techniques often increase the frequency of this construction, highlighting a gap between correctness and communicative appropriateness in current LLMs.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.