arXiv AI By Junchi Liao

Writing for the Reviewer: Defensive Writing in GPT Models

Read the original on arXiv AI →

The paper investigates how newer GPT models alter scientific text, a phenomenon termed defensive writing, where the models either retract or weaken authors’ claims. Experiments show that as GPT versions advance, defensive writing becomes more pronounced, especially when the model is prompted to anticipate reviewer concerns. The study finds that this effect is largely driven by the anticipated-review explanation rather than mere correction of overclaiming, and that while AI reviewers rate such rewrites favorably, human readers perceive them as harder to read and less confident.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Oct 8

Writing for the Reviewer: Defensive Writing in GPT Models

Researchers find that newer GPT models increasingly rewrite academic paragraphs in a way that weakens or retracts the original authors’ claims—a phenomenon they term "defensive writing." The study shows that this effect grows with GPT version, with GPT‑6‑astra often removing claims outright and adding ungrounded qualifiers when rewriting from evidence sheets. The authors suggest that the models are likely tailoring text for an anticipated reviewer rather than simply correcting overclaiming, and that this defensive style can be amplified when AI writing is combined with AI review.

arXiv AI
Oct 15

Defensive Writing in GPT Models

arXiv:2610.11355v2 Announce Type: replace Abstract: Researchers increasingly use ChatGPT to revise their papers, and when asked to make a paper hold up under review, recent GPT versions often narrow...

By Junchi Liao, Xiao Huang, Yucheng Liu, Jiawen Deng, Fuji Ren
arXiv Computation and Language
3d ago

A Harness Reducing over-Defensive Writing in Agents by Isolating Objections

The paper introduces a harness designed to curb over‑defensive writing by agents, which occurs when agents add stronger claims than the source material and then retract them. The harness separates the reviewer, filter, and writer components, allowing the writer to focus only on problems selected by an independent filter. Evaluation on 25 business‑project drafts shows a 96.61% drop in defensive propositions and an increase in source‑claim retention from 80.35% to 93.12%.

By Xiaochen Chang
arXiv AI
Aug 11

How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review

arXiv:2608. 08975v1 Announce Type: cross Abstract: As large language models increasingly participate in scientific evaluation, we investigate a potential form of reward hacking: how rhetorical choices shape AI-review judgments when reported scientific content is preserved and how these effects vary across evaluation conditions.

By Ming Li, Chenguang Wang, Xirui Li, Xinyue Zeng, Dianqi Li, Peng Shi, Dawei Zhou, Tianyi Zhou
Hugging Face Trending Papers
Aug 10

How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review

As large language models increasingly participate in scientific evaluation, we investigate a potential form of reward hacking: how rhetorical choices shape AI-review judgments when reported scientific content is preserved and how these effects vary across evaluation conditions. We construct a controlled corpus of 4,200 full-paper manuscripts derived from 120 anonymized ICLR 2026 submissions.

arXiv AI
Sep 4

More Criticism Does Not Make a Better Review: EquiReview-R

The paper introduces EquiReview‑R, an AI‑assisted review system that treats omission and over‑critique as distinct risks and refines a structured concern set using evidence‑linked reasoning. It demonstrates that more criticism does not guarantee a better review, showing that many high‑recall reviews lack definitive evidence for concerns and that revision before further search is essential. On a held‑out set of papers, EquiReview‑R meets non‑inferiority for major omission, cuts major over‑critique from 15.5 % to 8.1 %, and stops on 52.4 % of papers, with gains attributed to revision rather than extra inference.

By Zexing Zhang, Jichao Li, Tianyang Lei, Yude Fu, Yang Kewei