arXiv AI By Prabhjot Singh, Somnath Luitel, Manmeet Singh, Josh Durkee

FIRSTPASS: A Multi-Domain, Multi-Round Peer Review Dataset Grounded in Real Editorial Outcomes

Read the original on arXiv AI →

FIRSTPASS is a large-scale peer review dataset that captures complete multi-round editorial dialogues from a multidisciplinary high-impact journal, Nature Communications. It contains 3,668 records across five scientific domains—biology, chemistry, neuroscience, physics, and earth science—encompassing initial referee reports, author responses, and updated reviewer assessments. Each record is labeled with an outcome (STANDARD or EXTENDED) based on editorial decisions, and the dataset includes detailed parsing pipelines and evaluation scripts for reproducible AI benchmarking.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Aug 4

AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Quality

AI-assisted peer review is increasingly discussed and adopted as a tool to support the scientific publishing process, yet there is little systematic understanding of how publication venues regulate its use or of how capable current AI review systems are. We address these questions by first surveying reviewer-facing AI policies across 111 leading AI/NLP conferences and medical journals, revealing substantial regulation differences between the two communities.

arXiv AI
Aug 5

AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Quality

arXiv:2608. 03581v1 Announce Type: cross Abstract: AI-assisted peer review is increasingly discussed and adopted as a tool to support the scientific publishing process, yet there is little systematic understanding of how publication venues regulate its use or of how capable current AI review systems are.

By Alexander M. Fichtl, Lukas Ellinger, Josefin Kelber, Kry\v{s}tof Ol\'ik, Georg Groh