arXiv AI

More Than Mimicking Reviewers: Evaluating LLMs for Pre-Submission Peer Review

The paper introduces an author-facing large language model (LLM) system that generates a broad set of atomic concerns about a manuscript and compresses them into a concise report, aiming to provide early peer‑review feedback. Evaluations on 3,398 ICLR 2026 submissions show that the system covers 44.9% of historical reviewer issues on a diagnostic set, rising to 78.7% strict coverage and 84.9% seriousness‑weighted coverage after deduplication and refill, using 3.6× more requests and 5.2× more tokens. Ablation studies reveal that representative selection and matcher sensitivity are key factors limiting the compression quality.

arXiv AI
Jul 15

AAAI-26 Dual Submissions: Novel Challenges

arXiv:2607. 11918v1 Announce Type: cross Abstract: Dual submissions, in which identical or substantially similar papers are simultaneously submitted to one or more archival venues, without cross-citation or disclosure, are a growing problem for the AAAI Conference and other scientific publication venues.

By Kiri L. Wagstaff, Joydeep Biswas, Erich Merrill III, Bo An, Ida Camacho, David J. Crandall, Matthew E. Taylor
arXiv Computation and Language
Sep 23

Peerify: Benchmarking Peer-Review Claim Verification

arXiv:2609.25046v1 Announce Type: new Abstract: Peer review plays a central role in scholarly publishing, yet verifying whether reviewer claims are supported by manuscript evidence remains a largely...

By Alireza Daghighfarsoodeh, Sajad Ebrahimi, Ali Ghorbanpour, Soroush Sadeghian, Radin Cheraghi, Negar Arabzadeh, Ebrahim Bagheri