Hugging Face Trending Papers

Lipi-Ghor: A Large-Scale, Diarized, Multi-Domain Bengali Speech Corpus and a Scalable Pipeline for Building It

arXiv Computation and Language
Oct 28

Lipi-Ghor: A Large-Scale, Diarized, Multi-Domain Bengali Speech Corpus and a Scalable Pipeline for Building It

Lipi-Ghor is a large-scale, weakly-supervised Bengali speech corpus containing 885 hours of audio from 998 YouTube videos across 17 domains, each annotated in SSTT format with speaker diarization and timestamps. It is the first Bengali corpus to combine extensive coverage with speaker-diarized, long-form audio annotations, and the authors provide a replicable pipeline for building similar resources in other languages. The dataset includes a human-annotated gold evaluation split and is released under CC‑BY‑4.0, with raw audio withheld.

By Sanjid Hasan, A H M Fuad, Risalat Labib, Bayazid Hasan Simon
arXiv Computation and Language
1d ago

Automated Video-to-QA Pipeline: End-to-End Question Generation and Verification Using Large Language Models

The paper introduces an automated pipeline that converts educational videos into structured summaries and high‑quality question‑answer pairs. It uses FFmpeg for audio extraction, Whisper for speech recognition, BART for transcript summarization, and Llama‑3.1‑8BInstruct for generating and self‑verifying QA pairs. The verified pairs form a synthetic dataset that fine‑tunes the Llama model via LoRA, producing a domain‑specific question generator without manual annotation.

By Jaival Chauhan, Vikram Singh, Pruthwik Mishra
arXiv Computation and Language
Sep 18

The Public Discourse Corpus (PDC): A Speaker-Attributed Dataset for Valence and Epistemic Modality with Target Speaker Participation

The Public Discourse Corpus (PDC) is the first dataset of public‑figure interview speech annotated for affective valence and epistemic modality. It contains 998 videos from 100 speakers across seven professional domains, yielding 186,642 sentences (3.1 million words). A key methodological contribution is Target Speaker Participation (TSP), a five‑category annotation taxonomy with documented inter‑annotator reliability (κ = 0.616), and an audio‑first diarization pipeline that separates target‑speaker turns from interviewer and third‑party speech. The corpus, annotation tools, validation sample, and processing pipeline are released as open source.

By Bo Chen
arXiv AI
Sep 21

MENASpeechBank: A Reference Voice Bank with Persona-Conditioned Multi-Turn Conversations for AudioLLMs

MENASpeechBank is a new reference voice bank that provides about 18,000 high‑quality utterances from 124 speakers across multiple MENA countries, covering English, Modern Standard Arabic, and regional Arabic varieties. The dataset is built through a controllable pipeline that creates persona profiles inspired by the World Values Survey, defines a taxonomy of roughly 5,000 conversational scenarios, matches personas to scenarios via semantic similarity, and generates around 417,000 role‑play conversations using an LLM. Synthetic speaker‑conditioned user‑turn audio is produced from reference recordings to maintain speaker diversity, and both synthetic and human‑recorded conversations are evaluated and analyzed for quality.

By Zien Sheikh Ali, Hunzalah Hassan Bhatti, Rabindra Nath Nandi, Shammur Absar Chowdhury, Firoj Alam
arXiv Computation and Language
Aug 24

Building and Evaluating a Synthetic Bengali Speech Resource for Telecom Customer Care

The paper introduces a synthetic Bengali speech dataset tailored for telecom customer‑care applications, comprising 10,000 audio‑text pairs (≈26.82 hours) with predefined train, validation, and test splits. The data were generated using OmniVoice voice‑cloning, and include both original and normalized transcripts for ASR/STT use. Automatic intelligibility evaluation with a fine‑tuned Whisper model shows an average WER of 2.54% and CER of 0.59%, indicating strong text‑audio consistency, while the authors note limitations of synthetic speech and STT‑based evaluation.

By Kawshik Kumar Paul, Md. Nafiul Alam Fuji
arXiv Computation and Language
Sep 11

Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understanding

The paper introduces methods to improve speech recognition for multilingual video transcription using Whisper-based tools, targeting cross‑cultural understanding. It reports an average transcription error rate of 30% across seven languages, which can be lowered to 20% with modest fine‑tuning. The authors also release associated speech and metadata to aid community refinement of these techniques.

By Michael Picheny