Hugging Face Blog
Accelerating Qwen3-8B Agent on Intel® Core™ Ultra with Depth-Pruned Draft Models
Read the original on Hugging Face Blog →The Flow has not summarised this story yet — read it at Hugging Face Blog.
Related stories
Hugging Face Blog
Nov 2, 2022
Accelerate your models with 🤗 Optimum Intel and OpenVINO
arXiv Machine Learning
Jul 7
Quantize the Target, Quantize the Drafter: Efficient Inference with Qwen3.5-4B
arXiv:2607. 04244v1 Announce Type: new Abstract: This report describes our approach to the Efficient Qwen Competition, where the goal is to enable low-latency serving of Qwen3.
arXiv AI
4d ago
Nanbeige4.2-3B on Apple Silicon: Fixing Deployment Bugs and Decreasing Looped Transformer Memory Overhead
arXiv:2608. 13987v1 Announce Type: new Abstract: Nanbeige4.
Simon Willison
5d ago
Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things
Friday's big release was Qwen 3. 8 27B , an Apache 2 licensed 27B parameter vision-capable LLM from Alibaba's Qwen research lab.
arXiv AI
Jun 19
UltraQuant: 4-bit KV Caching for Context-Heavy Agents
arXiv:2606. 20474v1 Announce Type: cross Abstract: Context-heavy agents place unusual pressure on the key-value (KV) cache: long prefixes are reused across many short turns, while concurrency determines whether the serving system can keep GPUs utilized.
arXiv AI
Jun 12
Can I Buy Your KV Cache?
arXiv:2606. 13361v1 Announce Type: new Abstract: Right now, across the world, AI agents are repeating the same absurd act: to read one document, they each recompute it from scratch.