arXiv AI By Yash Tripathi, Silu Sharma, Sai Sidhanth Manoharan Jayanthi, Shivank Garg, Lin Li

Diagnostic Foundation for Evaluating LLMs' Research Integrity as Co-Scientists

Read the original on arXiv AI →

arXiv:2608. 12345v1 Announce Type: new Abstract: Language models are increasingly deployed as co-scientists, yet their ability to uphold research integrity under institutional pressure remains unmeasured.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 8

FirstResearch: Auditable Question Formation for LLM Scientific Discovery Agents

arXiv:2607. 05682v1 Announce Type: new Abstract: LLM systems for scientific discovery increasingly assist with ideation, literature synthesis, experiment planning, and report generation, but the first research question they propose can remain difficult to audit: it may sound plausible without exposing the mechanism, falsifier, or assumption that a scientist should inspect.

By Yufeng Wang
arXiv Computation and Language
Sep 18

Towards Safer RAG: Only Agents Capable of System 2 Thinking may Access Untrusted Documents

The paper examines how deliberative (System 2) reasoning affects a Retrieval-Augmented Generation (RAG) model’s vulnerability to knowledge‑poisoning attacks. Using two metrics—Cordon Rate and Leakage Rate—it evaluates six model configurations on 200 SciFact questions. Results show that enabling reasoning lowers both Cordon and Leakage Rates for DeepSeek‑V4‑Flash, indicating reduced behavioral impact from poisoned evidence, though overall attack success increases.

By Mehrdad Ghassabi, Audrina Ebrahimi, Sadra Hakim, Hamidreza Baradaran Kashani