arXiv Machine Learning June 29, 2026 By Carrie Chen

EntMTP: Accelerating LLM Inference with Entropy Guided Multi Token Prediction

Read the original on arXiv Machine Learning →

arXiv:2606. 27550v1 Announce Type: cross Abstract: Multi-token prediction has been shown to increase data density during training, improve downstream text-generation quality, and serves as the defacto approach for self-speculative decoding.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 24

STS: Efficient Sparse Attention with Speculative Token Sparsity

arXiv:2605.15508v3 Announce Type: replace Abstract: The quadratic complexity of attention imposes severe memory and computational bottlenecks on Large Language Model (LLM) inference. This challenge i...

By Jiangnan Yu, Ceyu Xu, Yongji Wu, Yuan Xie

llms agents efficiency benchmarks

arXiv Machine Learning

4d ago

SEED: Self-Speculative Decoding via Implicit Encoder-Decoder

arXiv:2609.36590v1 Announce Type: cross Abstract: Self-speculative decoding accelerates large language model (LLM) inference by drafting tokens from the target model itself, but faces a sharp tradeof...

By Hankun Lin, Patrick Pynadath, Ruqi Zhang

llms fine-tuning benchmarks

arXiv AI

Aug 18

Dynamic Multi-Byte Prediction With Hierarchical Language Models

arXiv:2608. 15454v1 Announce Type: new Abstract: Byte-level hierarchical language models (LMs) have recently emerged as a robust alternative to their popular counterparts that use subword tokenization.

By Abraham Toluwase Owodunni, Chibuzor Okocha, Christan Grant, Tomasz Limisiewicz, Sachin Kumar

llms nlp efficiency

arXiv AI

Sep 1

Entropy-Aware Token Rejection for Improving Speculative Decoding

arXiv:2512.23765v2 Announce Type: replace-cross Abstract: Speculative decoding (SD) accelerates large language model (LLM) inference by using a lightweight draft model to propose tokens and a stronge...

By Tiancheng Su, Meicong Zhang, Guoxiu He

llms benchmarks

Hugging Face Trending Papers

Aug 16

Dynamic Multi-Byte Prediction With Hierarchical Language Models

Byte-level hierarchical language models (LMs) have recently emerged as a robust alternative to their popular counterparts that use subword tokenization. However, generating one byte at a time remains...

llms nlp efficiency

arXiv Computation and Language

3d ago

DEdit: Iterative Draft Editing for Speculative Decoding

arXiv:2609.38510v1 Announce Type: new Abstract: Speculative decoding accelerates autoregressive LLMs by having a lightweight drafter propose tokens that the target model verifies in parallel. Diffusi...

By Longxuan Yu, Bingsen Chen, Peng Shi, Dongkyu Lee, Yi Xiang, Hideo Kobayashi, Sheng Zhang, Shuaichen Chang, Xing Niu, Zhuoyan Xu, Greg Ver Steeg, Jiarong Jiang

llms diffusion benchmarks

One email a morning, machine-written

Related stories

STS: Efficient Sparse Attention with Speculative Token Sparsity

SEED: Self-Speculative Decoding via Implicit Encoder-Decoder

Dynamic Multi-Byte Prediction With Hierarchical Language Models

Entropy-Aware Token Rejection for Improving Speculative Decoding

Dynamic Multi-Byte Prediction With Hierarchical Language Models

DEdit: Iterative Draft Editing for Speculative Decoding