Hugging Face Trending Papers June 24, 2026

Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?

Read the original on Hugging Face Trending Papers →

Connecting a pre-trained speech encoder to a Large Language Model (LLM) is the standard architecture for building Speech LLMs. However, a structural misalignment exists between the encoder and the LLM.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI

Aug 6

Breaking the Curse ofMultilinguality inMany-to-Many Speech-to-Text Translation via a Resource-AwareMixture of Speech Encoders

arXiv:2608. 04586v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) have achieved significant success in speech-to-text translation (S2TT).

By Yexing Du, Kaiyuan Liu, Youcheng Pan, Bo Yang, Chengpeng Fu, Yu Wang, Ming Liu

llms multimodal benchmarks safety

arXiv AI

Aug 7

Breaking the Curse of Multilinguality in Many-to-Many Speech-to-Text Translation via a Resource-Aware Mixture of Speech Encoders

arXiv:2608. 04586v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved significant success in speech-to-text translation (S2TT).

By Yexing Du, Kaiyuan Liu, Youcheng Pan, Bo Yang, Chengpeng Fu, Yu Wang, Ming Liu

llms multimodal benchmarks safety

arXiv Computation and Language

Sep 22

Efficient and Adaptive Simultaneous Speech Translation with Fully Unidirectional Architecture

arXiv:2504.11809v2 Announce Type: replace Abstract: Simultaneous speech translation (SimulST) produces translations incrementally while processing partial speech input. Although large language models...

By Biao Fu, Donglei Yu, Minpeng Liao, Chengxi Li, Xinjie Chen, Yidong Chen, Kai Fan, Xiaodong Shi

llms

arXiv Computation and Language

Sep 22

Federated Multilingual Speech-LLMs: Architecture and Aggregation Strategy Benchmarking

arXiv:2609.23825v1 Announce Type: new Abstract: We present a comprehensive benchmark of Federated Learning (FL) for multilingual Automatic Speech Recognition (ASR), evaluating four Speech-LLM archite...

By Jordi Luque, Aleix Sant, Fernando L\'opez

llms fine-tuning multimodal benchmarks safety

Hugging Face Trending Papers

Sep 16

Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs

Speech Large Language Models (Speech-LLMs), typically built from a pre-trained speech encoder, a modality projector, and an LLM fine-tuned with Low-Rank Adapters (LoRA), have shown strong Automatic Sp...

llms fine-tuning multimodal benchmarks

arXiv Machine Learning

Sep 10

Interleaved Speech Language Models Latently Work In Text

arXiv:2606.22473v2 Announce Type: replace-cross Abstract: Speech language models (SLMs) increasingly combine speech and text, often by interleaving their tokens within a single sequence. Yet how thes...

By Talia Sternberg, Gallil Maimon, Yossi Adi

llms diffusion multimodal