← Back to all news
Hugging Face Blog October 29, 2024

Universal Assisted Generation: Faster Decoding with Any Assistant Model

Read the original on Hugging Face Blog →

The Flow has not summarised this story yet — read it at Hugging Face Blog.

One email a morning, machine-written

One email a day, machine-written, one click to leave. We never share your address.

Related stories

Hugging Face Blog
Mar 1, 2020

How to generate text: using different decoding methods for language generation with Transformers

llms
More like this →
Hugging Face Blog
May 11, 2023

Assisted Generation: a new direction toward low-latency text generation

More like this →
arXiv AI
Jul 24

DC-Leap: Training-Free Acceleration of dLLMs via Draft-Guided Contiguous Leaping Decoding

arXiv:2607. 20467v1 Announce Type: new Abstract: While parallel decoding is central to the efficiency of Diffusion Large Language Models (dLLMs), current strategies are often hindered by overly conservative confidence thresholds.

By Yanhua Jiao, Tianyi Wu, Xiaoxi Sun, Yulin Li, HuiLing Zhen, Libo Qin, Baotian Hu, Zhuotao Tian, Min Zhang
llmsdiffusionbenchmarks
More like this →
Hugging Face Blog
Nov 20, 2024

Faster Text Generation with Self-Speculative Decoding

More like this →
arXiv Machine Learning
Jul 24

Gumbel Distillation for Parallel Text Generation

arXiv:2603. 22216v2 Announce Type: replace-cross Abstract: The slow, sequential nature of autoregressive (AR) language models has driven the adoption of parallel decoding methods.

By Chi Zhang, Xixi Hu, Bo Liu, Qiang Liu
llmsefficiency
More like this →
arXiv AI
Jun 24

WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models

arXiv:2604. 08558v2 Announce Type: replace-cross Abstract: Recent decoder-only autoregressive text-to-speech (AR-TTS) models produce high-fidelity speech, but their memory and compute costs scale quadratically with sequence length due to full self-attention.

By Hanna Lee, Tan Dat Nguyen, Jaehoon Kang, Kyuhong Shim
fine-tuningefficiencymultimodal
More like this →
About Pricing API Newsletter Sources Privacy Terms Refunds Accessibility Provider info Contact RSS

The Flow links to publishers and never republishes their articles. Summaries are machine-generated.

v1.0.0 · bb4ee0e