arXiv Machine Learning June 2, 2026 By Zining Liu, Yunhai Hu, Tianhua Xia, Bo Bao, Eric Sather, Vithursan Thangarasa, Sai Qian Zhang

DREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal Generation

Read the original on arXiv Machine Learning →

arXiv:2606. 00535v1 Announce Type: new Abstract: Speculative decoding (SD) has proven to be an effective technique for accelerating autoregressive generation in large language models (LLMs) however, its application to vision-language models (VLMs) remains relatively unexplored.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision

2d ago

HAWK: Rethinking Multimodal Drafting for Speculative Decoding

arXiv:2610.00623v1 Announce Type: new Abstract: Speculative decoding has achieved substantial lossless speedups for LLMs, but remains less effective for large vision-language models (LVLMs), where li...

By Wenhan Yang, Anirudh Rao, Ashwin Chandra

llms efficiency multimodal benchmarks

arXiv Machine Learning

4d ago

SEED: Self-Speculative Decoding via Implicit Encoder-Decoder

arXiv:2609.36590v1 Announce Type: cross Abstract: Self-speculative decoding accelerates large language model (LLM) inference by drafting tokens from the target model itself, but faces a sharp tradeof...

By Hankun Lin, Patrick Pynadath, Ruqi Zhang

llms fine-tuning benchmarks

arXiv AI

Aug 12

MemSpec: Memory-Aware Runtime for Adaptive Draft Scheduling in Speculative Decoding on Edge Devices

arXiv:2608. 10362v1 Announce Type: cross Abstract: Speculative decoding accelerates autoregressive large language model (LLM) inference by using a lightweight draft model to speculate multiple tokens, reducing expensive target model decoding steps.

By Eunjeong Kim, Yeong Jun Jeon, Myeonggyun Han

llms reinforcement-learning efficiency benchmarks

arXiv AI

Jun 3

KnapSpec: Self-Speculative Decoding via Adaptive Layer Selection as a Knapsack Problem

arXiv:2602. 20217v2 Announce Type: replace-cross Abstract: Self-speculative decoding (SSD) accelerates LLM inference by skipping layers to create an efficient draft model, yet existing methods often rely on static heuristics that ignore the dynamic computational overhead of attention in long-context scenarios.

By Seongjin Cha, Gyuwan Kim, Dongsu Han, Tao Yang, Insu Han

llms efficiency benchmarks

arXiv AI

2d ago

Architectural Sampling: Test-Time Scaling via Computational Diversity in Frozen Vision-Language Models

arXiv:2610.01687v1 Announce Type: cross Abstract: Test-time scaling often seeks better answers by sampling multiple responses from a frozen model, yet conventional temperature sampling generates ever...

By Akshit Singh, Shyam Marjit, Wei Lin, Leonid Karlinsky, M. Jehanzeb Mirza

llms reinforcement-learning multimodal benchmarks

arXiv AI

Jun 4

SSSD: Simply-Scalable Speculative Decoding

arXiv:2411. 05894v3 Announce Type: replace-cross Abstract: Speculative Decoding has emerged as a popular technique for accelerating inference in Large Language Models.

By Michele Marzollo, Jiawei Zhuang, Niklas Roemer, Niklas Zwingenberger, Lorenz K. M\"uller, Lukas Cavigelli

llms benchmarks

One email a morning, machine-written

Related stories

HAWK: Rethinking Multimodal Drafting for Speculative Decoding

SEED: Self-Speculative Decoding via Implicit Encoder-Decoder

MemSpec: Memory-Aware Runtime for Adaptive Draft Scheduling in Speculative Decoding on Edge Devices

KnapSpec: Self-Speculative Decoding via Adaptive Layer Selection as a Knapsack Problem

Architectural Sampling: Test-Time Scaling via Computational Diversity in Frozen Vision-Language Models

SSSD: Simply-Scalable Speculative Decoding