arXiv AI
Jun 29
The Shift Toward Open and Reproducible AI Research
arXiv:2606. 16974v3 Announce Type: replace Abstract: The reproducibility crisis has directed the AI research community toward improving documentation practices.
The embrace of open science: An analysis of a decade of AI research and 56 800 conference papers
arXiv:2606. 16974v1 Announce Type: new Abstract: The reproducibility crisis has directed the AI research community toward improving documentation practices.
Related stories
arXiv AI
Jun 9
Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting
arXiv:2606. 09809v1 Announce Type: new Abstract: AI evaluation results are produced at scale but reported inconsistently across leaderboards, model cards, benchmark papers, and company blogs.
arXiv AI
Jun 11
Can AI Agents Synthesize Scientific Conclusions?
arXiv:2606. 11337v1 Announce Type: new Abstract: Scientific AI agents increasingly retrieve evidence, reason across sources, and synthesize conclusions used in consequential decisions.
arXiv AI
Jul 29
Measuring the State of Open Science in Transportation Using Large Language Models
arXiv:2601. 14429v2 Announce Type: replace-cross Abstract: Open science initiatives have strengthened scientific integrity and accelerated research progress across many fields, but the state of their practice within transportation research remains under-investigated.
arXiv AI
Aug 21
Symposium: Trust via Auditable Records for Communities of AI Scientist Agents
arXiv:2608. 19511v1 Announce Type: new Abstract: Symposium is a formal framework and practical implementation to record the operation of AI agents deployed by small scientific research communities.
Hugging Face Trending Papers
Jun 30
FARS: A Fully Automated Research System Deployed at Scale
Recent automated research systems show that language-model agents can generate hypotheses, run experiments, and write complete manuscripts, but most evidence still comes from selected examples, human-framed topics, or a few pre-defined research tasks. We present FARS (Fully Automated Research System), a fully automated AI-for-AI research system designed to operate across research topics at scale.
arXiv AI
Jul 1
FARS: A Fully Automated Research System Deployed at Scale
arXiv:2606. 31651v1 Announce Type: new Abstract: Recent automated research systems show that language-model agents can generate hypotheses, run experiments, and write complete manuscripts, but most evidence still comes from selected examples, human-framed topics, or a few pre-defined research tasks.
arXiv Computation and Language
Sep 14
PRISMA-LLM: An Empirical Reporting Framework for AI-Assisted Systematic Reviews
The paper introduces PRISMA-LLM, a reporting framework for AI-assisted systematic reviews. It is based on an analysis of 888 review-automation papers, showing a shift toward LLM- and software-driven workflows and inconsistent reporting of evaluation and limitations. The framework separates implementation details from consequence-sensitive evaluation and limitation reporting.
arXiv Computation and Language
Sep 16
PaperDoctor: Evidence-Grounded and Actionable Feedback for Scientific Papers in Progress
PaperDoctor is an agent framework that provides evidence‑grounded, actionable feedback for scientific papers before submission. It evaluates writing, layout, references, code, theory, prior work, and experiments through a three‑layer hierarchical system, linking each critique to specific evidence and revision suggestions. The system selectively rebuilds and reruns experiments to uncover reproducibility gaps, and an interactive interface lets authors explore findings tied to their manuscript.
arXiv AI
Jun 9
Context Rot in AI-Assisted Software Development: Repurposing Documentation Consistency for AI Configuration Artifacts
arXiv:2606. 09090v1 Announce Type: cross Abstract: Developers increasingly provide AI coding assistants with persistent context through configuration files such as CLAUDE.
arXiv AI
Aug 3
Can AI Evaluate AI Scientists? A Benchmarking Study of Autonomous Research Generation Systems Using Automated Multi-Model Review
arXiv:2607. 28631v1 Announce Type: new Abstract: AI Scientist systems capable of autonomous research have the potential to significantly accelerate scientific discovery.
arXiv Computation and Language
Sep 22
Beyond the Text: Verifying That Agent-Written Papers Are Backed by Their Artifacts
arXiv:2609.22111v1 Announce Type: new Abstract: Large language model agents are increasingly capable of conducting research autonomously, producing research documents alongside the code and experimen...