Lipi-Ghor: A Large-Scale, Diarized, Multi-Domain Bengali Speech Corpus and a Scalable Pipeline for Building It
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Lipi-Ghor is a large-scale, weakly-supervised Bengali speech corpus containing 885 hours of audio from 998 YouTube videos across 17 domains, each annotated in SSTT format with speaker diarization and timestamps. It is the first Bengali corpus to combine extensive coverage with speaker-diarized, long-form audio annotations, and the authors provide a replicable pipeline for building similar resources in other languages. The dataset includes a human-annotated gold evaluation split and is released under CC‑BY‑4.0, with raw audio withheld.
arXiv:2610.19388v1 Announce Type: new Abstract: Massively multilingual speech modeling has made remarkable progress in recent years, yet existing training resources and benchmarks still underrepresen...
The paper introduces an automated pipeline that converts educational videos into structured summaries and high‑quality question‑answer pairs. It uses FFmpeg for audio extraction, Whisper for speech recognition, BART for transcript summarization, and Llama‑3.1‑8BInstruct for generating and self‑verifying QA pairs. The verified pairs form a synthetic dataset that fine‑tunes the Llama model via LoRA, producing a domain‑specific question generator without manual annotation.
The Public Discourse Corpus (PDC) is the first dataset of public‑figure interview speech annotated for affective valence and epistemic modality. It contains 998 videos from 100 speakers across seven professional domains, yielding 186,642 sentences (3.1 million words). A key methodological contribution is Target Speaker Participation (TSP), a five‑category annotation taxonomy with documented inter‑annotator reliability (κ = 0.616), and an audio‑first diarization pipeline that separates target‑speaker turns from interviewer and third‑party speech. The corpus, annotation tools, validation sample, and processing pipeline are released as open source.
arXiv:2607. 23808v1 Announce Type: cross Abstract: In this work, we introduce Indic DiarBench, a speaker diarization and ASR benchmark dataset spanning all 22 scheduled languages of India.
MENASpeechBank is a new reference voice bank that provides about 18,000 high‑quality utterances from 124 speakers across multiple MENA countries, covering English, Modern Standard Arabic, and regional Arabic varieties. The dataset is built through a controllable pipeline that creates persona profiles inspired by the World Values Survey, defines a taxonomy of roughly 5,000 conversational scenarios, matches personas to scenarios via semantic similarity, and generates around 417,000 role‑play conversations using an LLM. Synthetic speaker‑conditioned user‑turn audio is produced from reference recordings to maintain speaker diversity, and both synthetic and human‑recorded conversations are evaluated and analyzed for quality.