arXiv AI
Reading the News: Adapting Large Language Models to Swedish Journalism Through Continued Pre-Training
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Aug 31
Reading the News: Adapting Large Language Models to Swedish Journalism Through Continued Pre-Training
Large language models are increasingly capable in general, but their utility can remain modest in niche or understudied areas. One approach to address this limitation is to specialise existing models...
arXiv AI
Oct 1
Linguistic Loopholes in LLM Unlearning: From a 174-Language Benchmark to Coverage-Aware Unlearning
The paper introduces the problem of cross‑lingual loopholes in large language model (LLM) unlearning, where forgetting a fact in one language can leave it accessible in others. It presents a new 174‑language benchmark, the Cross‑Lingual Unlearning Tensor, and proposes COVER, a method that selects a subset of source languages to maximize unlearning coverage under a language budget. Experiments show COVER reduces residual knowledge by 7.8–27.3% compared to uniform selection and works on both synthetic and real low‑resource news data.
arXiv Computation and Language
Oct 8
MixedPEFT: Combining Multiple PEFT Methods with Mixed Objectives for Unsupervised Domain Adaptation
arXiv:2606.22272v2 Announce Type: replace Abstract: Applying pre-trained language models to new domains through full fine-tuning is computationally expensive and prone to catastrophic forgetting. To...
arXiv AI
Jun 18
Rethinking Cross-lingual Gaps from a Statistical Viewpoint
arXiv:2510. 15551v2 Announce Type: replace-cross Abstract: Any piece of knowledge is usually expressed in one or a handful of natural languages on the web or in any large corpus.
arXiv Computation and Language
Oct 5
Specializing Without Forgetting: Analyzing Knowledge Preservation in Multilingual Model Adaptation
arXiv:2606.00284v2 Announce Type: replace Abstract: While continual pretraining (CPT) is a practical way to extend large language models to new languages, na\"ive finetuning often erodes existing cap...
arXiv AI
Oct 27
Repetition over Diversity: High-Signal Data Filtering for Sample-Efficient German Language Modeling
arXiv:2604.28075v3 Announce Type: replace-cross Abstract: Recent research has shown that filtering massive English web corpora into high-quality subsets significantly improves training efficiency. Ho...