arXiv Computation and Language
Chronologic: Measuring Language Models' Ability to Represent the Past
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv Computation and Language
1d ago
Memory vs. Context? Influential Factors of Factual Recall in Language Models
arXiv:2609.24238v1 Announce Type: new Abstract: We reproduce and stress-test the work of Yu et al. (2023), who characterize how language models (LMs) arbitrate between memorized knowledge and contrad...
arXiv AI
Jul 1
HistoriQA-ThirdRepublic: Multi-Hop Question Answering Corpus for Historical Research, Parliamentary Debates from the French Third Republic (1870-1940)
arXiv:2606. 31325v1 Announce Type: new Abstract: We present HistoriQA-ThirdRepublic: a French-language dataset of multi-hop historical questions derived from parliamentary debates and newspapers of the French Third Republic.
arXiv Computation and Language
6d ago
Reading Between the Lines: Can LLMs Discover the Question Behind the Text?
The paper introduces "question archaeology," an evaluation task that asks models to infer the single, authentic question that motivated a text. It presents a new dataset of commissioned texts paired with their original research questions and distractors, and evaluates both proprietary and open‑source LLMs. Results show newer models outperform older ones, with BERT-based models lagging, and current LLMs even surpassing human performance on this task.
arXiv AI
Aug 12
Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility
arXiv:2608. 10315v1 Announce Type: cross Abstract: Large language models (LLMs) are powerful black-box systems, making it difficult to discern whether their answers reflect stable internal beliefs or superficial pattern matching.
Hugging Face Trending Papers
Jun 4
Can LLMs Be Constrained to the Past? Improving Knowledge Cutoff through Recall-Based Prompting
Prompted knowledge cutoff instructs a large language model (LLM) to act as if information beyond a specified cutoff date were unavailable. However, prior work mainly relies on direct-answer generation, which struggles when post-cutoff knowledge is not explicitly queried but is only causally related to the question.
arXiv AI
Jul 28
Same Question, Different Answers: Evaluating LLM Reliability Beyond Accuracy
arXiv:2607. 22554v1 Announce Type: new Abstract: Large language models (LLMs) often achieve strong accuracy on benchmarks, yet it remains unclear how reliably they apply this knowledge when the same question is phrased in different but equivalent ways.