arXiv Computation and Language

Collection-Date Assignment Redirects Answers in Temporal QA

arXiv AI
Aug 11

Time Present and Time Past: Benchmarking Large Language Models on Temporally Evolving Document Understanding

arXiv:2608. 08512v1 Announce Type: new Abstract: Evolving documents, such as laws, tax codes, and software documentation, are amended, replaced, and sometimes reverted over time, so a question has different correct answers at different dates.

By Mahbub E Sobhani, Md. Faiyaz Abdullah Sayeedi, Fahmid Hasan Chowdhury, Md Adnan Arefeen, Farig Sadeque, Md. Faizul Bari, Swakkhar Shatabda
arXiv Computation and Language
Sep 28

Stale-Document Poisoning: When Outdated Retrieval Overrides Correct Model Answers

The paper introduces "stale‑document poisoning," a temporal alignment failure where outdated retrieval evidence causes retrieval‑augmented generation models to produce incorrect answers even when the model could answer correctly without retrieval. A benchmark of 317 verified knowledge reversals across medicine, law, software, and platform policy shows that outdated evidence flips 30–37% of Llama and Qwen answers, rising to 66–75% when models are explicitly instructed to trust the document. The study demonstrates that providing explicit validity information and a recency‑aware re‑ranker can substantially reduce poisoning, highlighting the need for models to assess whether retrieved evidence remains applicable.

By Md Shamim Ahmed, Lukas Galke Poech, Richard R\"{o}ttger
arXiv AI
Sep 25

Ingest-Time Fact Compilation for Cost-Efficient and Reliable Question Answering over Revised Corpora

The paper introduces ingest‑time fact compilation, an architecture that preprocesses and compiles corpus data into self‑contained facts with resolved revisions, deletions, and source trust. By storing this compiled state, query‑time models can retrieve answers directly, avoiding costly reconstruction from raw passages. Experiments show that this approach reduces read cost per question by 12.89× and token usage by 21.6× while maintaining accuracy.

By Kyle Wild, Yusuke Takahashi, Asako Uraki
arXiv AI
Oct 28

When Retrieval Is Not Enough: Obsolete Facts in Agent Memory

The study shows that in memory‑agent benchmarks, simply retrieving the correct fact does not guarantee accurate answers. On the FactConsolidation task, increasing the evidence budget from 64 to 512 tokens caused accuracy to drop, even though the newest statement was present in every retrieved set. Experiments with Qwen models revealed that replacing an unrelated statement with an obsolete competing statement drastically reduced accuracy, indicating that outdated information can be more harmful than irrelevant evidence.

By Oleeviya Babu Poikarayil, Tony Basil Babu, Abdulrahman Nahhas, Het Darshan Mehta, Jawid Ahmad Baktash, Ernesto William De Luca, Klaus Turowski
arXiv Computation and Language
Sep 23

Knowledge Pull Requests for Continual Document Authoring

The paper introduces Knowledge Pull Requests (KPRs), a framework that enables continual document authoring by making each change interpretable. KPRs extract claims from new knowledge sources, filter and route them to appropriate sections, and flag conflicts with existing content, producing a ChangeLog that separates knowledge changes from textual edits. Experiments on revising Wikipedia and updating query-driven reports show that KPRs integrate more information, better preserve existing content, and improve question answering performance compared to rewriting from scratch or using frontier models with search.

By Alexander Martin, Benjamin Van Durme
arXiv Computation and Language
Oct 26

Context or Knowledge: How LLMs Attribute Their Own Answers

arXiv:2610.32109v1 Announce Type: new Abstract: Language models can answer a question from a supplied document or from their parametric knowledge. When later asked where the answer came from, what de...

By Kirill Afendulev, Alexey Dontsov, Alla Chepurova, Elena Tutubalina, Anton Korznikov
arXiv Computation and Language
Oct 16

TEM: Temporal State Tracking Memory for Large Language Model Agents

The paper introduces Temporal State Tracking Memory (TEM), a training‑free framework that stores facts as versioned records linked to their sources and retrieves the relevant versions in source order, labeling historical records before passing them to the answer model. TEM incorporates event memory and original dialogue turns to fill gaps in structured facts. Evaluations on 420 questions from 600 sessions with 60 personas show high key‑entity hit rates (75.71–97.62%) and significant improvements when historical labels are added, while keeping evidence compact (94–118 tokens per answer).

By Pengfeng Song, Yunkai Zhuang, Liye Shi
arXiv Computation and Language
2d ago

Cross-Prompt Reuse of Entity-Replacement Responses

The paper investigates how entity‑replacement responses can be reused across different English factual questions when model weights are fixed. By injecting hidden‑state changes from two source questions into a target question about the same entity, the authors compare predicted log‑probability shifts with actual measurements, finding that hidden reuse can reduce no‑change error by up to 49% on certain models and that a later protocol can achieve 58‑68% success on three cohorts. The study also notes that larger checkpoints, chat formats, and new entities affect replication, and that relation‑neutral changes at entity tokens lower relation‑selective error more effectively than random changes.

By Jinkun Chen, Xuemin Yu, Sijia Han, Vlado Keselj