arXiv Computation and Language
Billiger.de Products: A Bilingual Entity Matching Benchmark
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv Machine Learning
Aug 27
OpenSanctions Pairs: Large-Scale Entity Matching with LLMs
OpenSanctions Pairs is the first large‑scale public benchmark for entity matching on sanctions and OSINT data, comprising 755,540 expert‑labeled pairs drawn from over 1 million entities across 293 source datasets and 45 jurisdictions. The dataset spans multiple languages and writing systems, inconsistent structures, and time‑varying provenance, making it far more heterogeneous than prior benchmarks. Baseline experiments show a rule‑based matcher achieving 91.3 % F1, GPT‑4o reaching 99.0 % F1, and a locally deployable open‑source model scoring 98.2 % F1, with complementary failure modes that highlight the need to focus on downstream pipeline components.
arXiv AI
Jun 4
LCSHBench: A Multilingual, Consensus-Grounded Benchmark for Library of Congress Subject Heading Assignment
arXiv:2606. 04382v1 Announce Type: cross Abstract: Automated subject cataloging assigns controlledvocabulary headings to bibliographic records, but LCSH has no standard public benchmark.
arXiv Computation and Language
Sep 23
FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing
arXiv:2609.25298v1 Announce Type: new Abstract: Cultural evaluation coverage and robustness in language models are difficult to diagnose because pretraining corpora and cultural benchmarks are rarely...
arXiv AI
4d ago
Cross-Lingual Reusability of LLM Pipelines: Financial Extraction, Multilingual Reasoning, and Semantic Screening
arXiv:2610.27043v1 Announce Type: cross Abstract: Financial institutions increasingly deploy large language models (LLMs) in multilingual markets, raising a practical question: can pipelines develope...
arXiv Machine Learning
Jul 28
Beyond Scale and Generation: Understanding Language Model-based Entity Matching
arXiv:2607. 24688v1 Announce Type: cross Abstract: Entity matching identifies records that refer to the same real-world entity.
arXiv AI
Aug 20
When Do LLMs Actually Help? Evaluating LLMs as Data Quality Annotators
The paper evaluates large language models (LLMs) as data quality annotators on two e-commerce tasks: entity matching and brand mislabeling. In entity matching, a simple rule-based baseline matched the LLM’s zero-shot performance (F1≈0.95), and a few-shot prompt actually lowered performance, highlighting the risk of small-sample prompt tuning. For brand mislabeling, the LLM outperformed a naive rule baseline (F1 0.833 vs 0.721) by leveraging background knowledge, and demonstrated high consistency across repeated runs (99.7% agreement).