A Simple Method to Enhance Pre-trained Language Models with Speech Tokens for Classification
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
arXiv:2607. 06611v1 Announce Type: cross Abstract: Automatically recognizing the sentiment, positive or negative, from speech is a challenging task, requiring both the analysis of vocal inflections and the interpretation of uttered words.
AudioTETRIS is a training‑free, two‑stage token elimination framework designed for large audio language models. It leverages the geometry of audio encoder representations as an acoustic prior to compute per‑token importance scores, which guide progressive top‑k token selection across decoder layers. Experiments on Qwen2‑Audio‑7B, Phi‑4‑Multimodal, and Audio Flamingo 3 show that AudioTETRIS retains near‑full performance while using only 25% of audio tokens and outperforms existing training‑free baselines.
arXiv:2605.18041v2 Announce Type: replace Abstract: Omnimodal large language models (OmniLLMs) have recently gained increasing attention for unified audio-video understanding. However, processing lon...
arXiv:2606. 09234v1 Announce Type: cross Abstract: Recent state-of-the-art (SOTA) text-to-speech (TTS) systems typically adopt a cascaded pipeline consisting of a speech tokenizer, an autoregressive large language model (LLM), and a diffusion based flow-matching (FM) model, with these components trained independently.
arXiv:2607. 05196v1 Announce Type: cross Abstract: Audio intelligence involves understanding, reasoning about, and generating both audio and speech.
arXiv:2610.23745v1 Announce Type: cross Abstract: Recent large audio language models (LALMs) have extended their capabilities beyond lexical speech understanding to tasks requiring paralinguistic and...