arXiv Computation and Language September 1, 2026 By Orkun Yi\u{g}it Cengiz

Annotated Surrogate Retrieval for Polish Statutory Law

Read the original on arXiv Computation and Language →

The paper introduces three retrieval methods for Polish statutory law that use language‑model annotations attached to articles as surrogates. The methods—ASCR, ASCR‑H, and DTF—vary in cost and quality, with ASCR‑H achieving the highest rank‑one accuracy on bar exam questions, while DTF offers competitive performance with lower latency and cost. Extensive evaluation against 14 baselines on 300 exam questions demonstrates significant improvements in head‑rank accuracy and discusses limitations such as coverage asymmetry and negative results for lemmatisation, pseudo‑relevance feedback, and query rewriting.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI

Aug 11

Temporal Misgrounding in Legal RAG: A Versioned-Corpus Benchmark for French Tax Law

arXiv:2608. 09393v1 Announce Type: cross Abstract: We identify and quantify temporal misgrounding: the systematic retrieval and citation of the currently in-force version of a legal article when the applicable version is an earlier or future one.

By Rose Cymbler, Daniel Guez, Laurent Fabre

llms rag nlp benchmarks safety

arXiv Computation and Language

Aug 21

GreekBarRetrieval: A Benchmark for Greek Statutory Retrieval

arXiv:2608. 18752v2 Announce Type: replace-cross Abstract: Statutory retrieval is necessary for citation-grounded legal question answering, but remains underexplored for Greek.

By Ernest Beta, Odysseas S. Chlapanis, Dimitrios Galanis, Ion Androutsopoulos

llms nlp benchmarks

arXiv Machine Learning

Aug 4

Do Static Embeddings Add Value to Hybrid Dutch Retrieval?

arXiv:2608. 02112v1 Announce Type: new Abstract: Embedding benchmarks measure standalone model quality, but they do not establish whether a low-cost retriever contributes complementary ranking information once lexical and transformer-based retrieval are already combined.

By Ant\'onio Pereira Barata

llms rag benchmarks

arXiv AI

Oct 21

Corpus Quality Improves, Retrieval Utility Does Not: An Ablation of Preprocessing and Refinement in a Speech-to-QA Pipeline

arXiv:2610.27652v1 Announce Type: cross Abstract: Practitioners building training corpora with a pipeline of language models keep a preprocessing or refinement (post-process) stage when switching it...

By Wonsup Shin, Jingu Kim

llms benchmarks

arXiv AI

Oct 15

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generation with LLMs

SciRerankBench is a benchmark designed to evaluate rerankers in retrieval‑augmented large language models (RAG‑LLMs) for scientific literature question answering. It covers five scientific subjects and introduces three types of question‑context‑answer pairs—Noisy Contexts, Semantically Similar but Logically Irrelevant Contexts, and Counterfactual Contexts—to test noise resilience, relevance disambiguation, and factual consistency. The study evaluates 13 popular rerankers across five LLM families, offering detailed insights into their strengths and limitations.

By Haotian Chen, Qingqing Long, Meng Xiao, Xiao Luo, Wei Ju, Chengrui Wang, Yuanchun Zhou, Xuezhi Wang, Hengshu Zhu

llms rag nlp benchmarks

arXiv AI

Aug 5

SciRet: A Compute-Aware Empirical Study of Retrieval and Reranking for Scientific RAG

arXiv:2608. 03860v1 Announce Type: cross Abstract: We introduce SciRet, a compute-aware empirical study of retrieval-augmented generation for scientific question answering over CORD-19.

By Kaysarul Anas Apurba, Md. Hasibul Hasan, Rofiqul Alam Shehab, Asab Azad

rag nlp benchmarks

One email a morning, machine-written

Related stories

Temporal Misgrounding in Legal RAG: A Versioned-Corpus Benchmark for French Tax Law

GreekBarRetrieval: A Benchmark for Greek Statutory Retrieval

Do Static Embeddings Add Value to Hybrid Dutch Retrieval?

Corpus Quality Improves, Retrieval Utility Does Not: An Ablation of Preprocessing and Refinement in a Speech-to-QA Pipeline

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generation with LLMs

SciRet: A Compute-Aware Empirical Study of Retrieval and Reranking for Scientific RAG