arXiv Machine Learning August 27, 2026 By Chandler Smith, Magnus Sesodia, Friedrich Lindenberg, Christian Schroeder de Witt

OpenSanctions Pairs: Large-Scale Entity Matching with LLMs

Read the original on arXiv Machine Learning →

OpenSanctions Pairs is the first large‑scale public benchmark for entity matching on sanctions and OSINT data, comprising 755,540 expert‑labeled pairs drawn from over 1 million entities across 293 source datasets and 45 jurisdictions. The dataset spans multiple languages and writing systems, inconsistent structures, and time‑varying provenance, making it far more heterogeneous than prior benchmarks. Baseline experiments show a rule‑based matcher achieving 91.3 % F1, GPT‑4o reaching 99.0 % F1, and a locally deployable open‑source model scoring 98.2 % F1, with complementary failure modes that highlight the need to focus on downstream pipeline components.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 28

Beyond Scale and Generation: Understanding Language Model-based Entity Matching

arXiv:2607. 24688v1 Announce Type: cross Abstract: Entity matching identifies records that refer to the same real-world entity.

By Zeyu Zhang, Xue Li, Iacer Calixto, Paul Groth, Sebastian Schelter

llms rag fine-tuning benchmarks

arXiv Computation and Language

Oct 16

Cost-Efficient RAG for Entity Matching with LLMs: A Blocking-based Batch Processing Framework

The paper introduces CE‑RAG4EM, a cost‑efficient framework that applies retrieval‑augmented generation (RAG) to entity matching (EM) by using blocking‑based batch retrieval and generation. It demonstrates that, in a zero‑shot setting, CE‑RAG4EM achieves comparable or better matching quality than naive RAG while significantly reducing end‑to‑end overhead. Experiments on nine real‑world EM benchmarks show that the approach closes the knowledge grounding gap for LLM‑based EM, especially on datasets with ambiguous or sparse attributes, and provides clear guidance on balancing accuracy and computational cost through blocking size and retrieval granularity.

By Chuangtao Ma, Zeyu Zhang, Arijit Khan, Sebastian Schelter, Paul Groth

llms rag benchmarks

Hugging Face Trending Papers

Oct 7

Reliability of LLM Judges for Evaluating Entity Alignment

Entity Alignment (EA) identifies equivalent entities across knowledge graphs and is critical for knowledge base integration and ontology merging. Evaluating EA systems at scale requires expensive expe...

llms rag benchmarks safety

arXiv Machine Learning

Aug 7

Where Privacy Risk Lives in English-Source Multilingual RAG: A Stage-Decomposed Audit Across Five Query Languages

arXiv:2608. 05163v1 Announce Type: cross Abstract: A common assumption holds that switching to a non-English language makes a multilingual RAG system easier to attack for personal information.

By Yanhang Li, Zhichao Fan, Zexin Zhuang

llms rag benchmarks safety

arXiv AI

Aug 10

Multi-Legal-Bench: Evaluating LLMs on Legal Reasoning Across Jurisdictions, Languages, and Legal Traditions

arXiv:2605. 29738v2 Announce Type: replace-cross Abstract: Legal NLP benchmarks overwhelmingly evaluate a single language or aggregate tasks that differ fundamentally across jurisdictions, making cross-lingual comparison impossible.

By Volodymyr Ovcharov

llms nlp benchmarks safety

arXiv AI

Aug 7

OpenAI Privacy Filter: A Cross-Lingual, Cross-Domain PII Evaluation Across 32 Benchmarks

arXiv:2608. 02616v2 Announce Type: replace-cross Abstract: We present what is, to our knowledge, the first systematic evaluation of OpenAI's Privacy Filter (OPF), a 1.

By Rohith Uppala

llms fine-tuning benchmarks safety