arXiv Computation and Language October 9, 2026 By Szymon Kocur

Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch

Read the original on arXiv Computation and Language →

Wieszcz‑XIX is a 6.75‑billion‑token corpus of Polish texts from 1800‑1918, comprising 3.1 billion words across 294,369 documents, assembled from Wolne Lektury and the Internet Archive. The pipeline filters, deduplicates, audits for post‑1918 leakage, and splits at the document level, yielding a training set with only 0.04–0.38 % post‑1918 residue. From this corpus the authors train decoder‑only language models ranging from 47 M to 349 M parameters, demonstrating that larger models better preserve period spelling and exhibit temporal boundedness compared to modern Polish baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

llms

arXiv Machine Learning

Aug 4

Leak It: A Probabilistic Approach to Training-Data Extraction from Black-Box Language Models

arXiv:2608. 00144v1 Announce Type: new Abstract: Membership inference (MIA) on language models is usually summarised by an aggregate ROC-AUC, but such evaluations are confounded: model-free blind baselines separate members from non-members from surface text alone.

By Victor Maricato

llms safety

arXiv Computation and Language

Sep 30

Which papyrus HTR is good enough? Character-error-rate tolerance of four papyrological tasks on Greek texts

arXiv:2609.37755v1 Announce Type: new Abstract: Purpose: Most Greek papyri remain unpublished and undigitised; a handwritten text recognition (HTR) pipeline that transcribes them automatically would...

By Anton Repushko, Elena Chepel

benchmarks

arXiv Computer Vision

Sep 2

Can Scene Text Recognition Read Rare Compositions?

The paper reports that scene text recognition models, while achieving 89–97% accuracy on standard benchmarks, perform significantly worse on rare word–trigram combinations, with a 10–18 point drop in accuracy at the rare‑word/rare‑trigram corner across multiple languages and models. Scaling the vision backbone improves overall accuracy but does not alleviate this corner‑specific deficit. The authors identify the autoregressive decoder’s lexical prior as the root cause and show that architectural changes—specifically moving from autoregressive to CTC decoding—yield the largest improvement for these rare compositions.

By Genpei Zhang

benchmarks

arXiv Machine Learning

Aug 12

Leak It: Per-Document Extraction Beyond Aggregate Membership Inference

arXiv:2608. 00144v2 Announce Type: replace Abstract: Membership inference (MIA) on language models is usually summarised by aggregate ROC-AUC, but such evaluations are confounded: model-free blind baselines can separate members from non-members using surface text alone.

By Victor Maricato

llms safety

arXiv Machine Learning

Jul 7

The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices

arXiv:2603. 18482v2 Announce Type: replace-cross Abstract: Standard decoding strategies for text generation, including top-$k$, nucleus sampling, and contrastive search, select tokens based on likelihood, restricting outputs to high-probability regions.

By Esteban Garces Arias, Nurzhan Sapargali, Christian Heumann, Matthias A{\ss}enmacher

llms safety

arXiv Computer Vision

Aug 26

A machine-readable catalogue of the Tsiolkovsky papers (fond 555, Archive of the Russian Academy of Sciences), and a way to measure how well its handwriting can be read

arXiv:2608.03617v2 Announce Type: replace-cross Abstract: The personal archive of Konstantin Tsiolkovsky (1857-1935) is held as fond 555 of the Archive of the Russian Academy of Sciences. The archive...

By Vladimir Beskorovainyi

One email a morning, machine-written

Related stories

Leak It: A Probabilistic Approach to Training-Data Extraction from Black-Box Language Models

Which papyrus HTR is good enough? Character-error-rate tolerance of four papyrological tasks on Greek texts

Can Scene Text Recognition Read Rare Compositions?

Leak It: Per-Document Extraction Beyond Aggregate Membership Inference

The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices

A machine-readable catalogue of the Tsiolkovsky papers (fond 555, Archive of the Russian Academy of Sciences), and a way to measure how well its handwriting can be read