arXiv Machine Learning By Prasanth Bathala, Anubhav Shrimal, Sukhdeep Singh Kharbhanda, Pradyumna Lanka, Rohit Dhaipule

TACTICS: Taxonomy-Aware Intelligent Corpus Sampling for Machine Translation

Read the original on arXiv Machine Learning →

TACTICS is a method for selecting evaluation samples in machine translation that explicitly optimizes for coverage of rare linguistic categories, document-level coherence, and distributional fidelity to the full corpus. It builds a hierarchical taxonomy from a locale style guide, classifies segments, and chooses a fixed-budget subset that better represents the full range of phenomena a system must handle. Compared to random, lexical, or embedding-based selection, TACTICS improves coverage of rare categories and yields more accurate system rankings with fewer segments.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
Oct 12

Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion

The paper introduces SAFE‑QE, a training‑free, retriever‑agnostic method for query expansion that mitigates hallucinated terms from large language models. It uses a subsequence‑association filter to score candidate terms based on their reproducibility across randomised query contexts, down‑weighting terms that lack corpus support. SAFE‑QE then selects a broad yet consistent set of expansions via constrained coverage maximisation, and defines a new metric, the Hallucinated Expansion Term Rate, to quantify faithfulness. The approach matches state‑of‑the‑art ranking performance while injecting far fewer unsupported terms on TREC and BEIR benchmarks.

By Amit Kumar Jaiswal, Sagar Uprety, Prayag Tiwari
arXiv Computation and Language
3d ago

Dataset Collection and Fine-Tuning of NLLB for German--English Translation

The paper presents a curated German–English parallel corpus derived from OPUS Books, reduced from 45,000 raw sentence pairs to 25,000 high‑quality examples through filtering and quality scoring. It details a reproducible fine‑tuning process for Meta’s NLLB‑200 models using mixed precision and gradient techniques, yielding a fine‑tuned NLLB‑600M model that improves BLEU, chrF++, and TER scores on literary and technical translations. The authors also integrate the model into the LinguaHaru translation system, enabling format‑preserving translation of PDFs and Office documents, and release all scripts, code, and the model on HuggingFace.

By SK Deeraj, Yash Ingle, Pruthwik Mishra
Hugging Face Trending Papers
Aug 11

ReLTEx: Reliable LLM-based Taxonomy Expansion

Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in generating semantically relevant concepts and relations, making them promising tools for taxonomy enrichment. However, directly relying on LLM-generated expansions often leads to noisy, redundant, or hierarchically inconsistent structures, limiting their reliability for automated taxonomy expansion.