Hugging Face Trending Papers
Comprehension Audits to Mitigate Risks from Automated AI Research
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Jun 6
Human Oversight and Overload: Two Hidden and Costly Burdens of AI-Assisted Software Engineering
arXiv:2606. 05770v1 Announce Type: cross Abstract: AI is changing how software engineers work, but it often comes with hidden burdens and costs.
arXiv AI
Aug 7
AISPA: User-Centric System Prompt Auditing for Large Language Model Applications
arXiv:2607. 28617v2 Announce Type: replace Abstract: System prompts are instructions configured by developers to govern the behaviors of foundation models in AI applications.
arXiv AI
Sep 10
Explaining AI Agents Through Execution Traces
arXiv:2609.06063v1 Announce Type: new Abstract: AI Agents are increasingly deployed in real-world settings, where they interact with external tools and make sequential decisions with limited human ov...
arXiv AI
Oct 19
Author-in-the-loop Agentic Reproducibility Auditing for a Machine Learning Conference
The paper introduces an author‑in‑the‑loop collaborative audit system for reproducibility checks during peer review, where authors explicitly declare reproduction instructions via a structured checklist. An AI agent uses these declarations to investigate and assess reproducibility, while human reviewers approve requests and decide on issue resolution. The system was deployed on 36 conference papers, identifying 20 issues that were subsequently resolved, and the study examined how different checklist conditions affected the agent’s assessment.
arXiv AI
Aug 6
A Chain Is Only as Strong as Its Weakest Link: A Scoping Review of System Integration Audits in AI
arXiv:2608. 04921v1 Announce Type: cross Abstract: As AI systems become increasingly integrated into diverse interfaces and applications, model-centric audits are insufficient to address risks arising from interactions among system components and deployment environments.
arXiv AI
Jul 9
Reasoning Consistency Scanning: A Framework for Auditing Chain-of-Thought Validity in AI Safety Evaluations
arXiv:2607. 07229v1 Announce Type: new Abstract: Prior work has shown that chain-of-thought (CoT) reasoning is often unfaithful: a model's stated reasoning does not reliably reflect the process that produced its output.