arXiv Machine Learning August 3, 2026 By Zhanglu Yan, Kaiwen Tang, Zixuan Zhu, Zhenyu Bai, Qianhui Liu, Yongxin Zhu, Weng-Fai Wong

Matterhorn: Masked Time-to-First-Spike Encoding by Reassigning the Silent State for Sparse and Energy-Efficient Spiking Transformers

Read the original on arXiv Machine Learning →

arXiv:2601. 22876v2 Announce Type: replace Abstract: Spiking neural networks (SNNs) promise energy-efficient inference for large language models (LLMs), yet most reported savings rely on compute-operation counts that overlook data movement.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers

Jul 29

The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

Spiking neural networks (SNNs) are promoted as an energy-efficient substrate because sparse, event-driven activity replaces dense multiply-accumulates with cheap accumulates. We argue the energy dividend of sparsity is not a property of SNNs but of the task.

llms efficiency

arXiv Machine Learning

Jul 30

The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

arXiv:2607. 26648v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) are promoted as an energy-efficient substrate because sparse, event-driven activity replaces dense multiply-accumulates with cheap accumulates.

By Zeyu Wang

llms efficiency

arXiv AI

Jun 3

Spike-Aware C++ INT8 Inference for Sparse Spiking Language Models on Commodity CPUs

arXiv:2606. 03026v1 Announce Type: cross Abstract: Spiking language models expose activation sparsity that dense Transformer runtimes do not directly exploit.

By Ting Liu

llms agents robotics efficiency benchmarks

arXiv AI

Sep 10

SymbolicLight V1: Spike-Gated Dual-Path Language Modeling at High Encoder Spike Sparsity

arXiv:2605.21333v3 Announce Type: replace-cross Abstract: Natively trained spiking language models must preserve information across time while operating through sparse binary activations, a combinati...

By Ting Liu

llms nlp efficiency benchmarks

arXiv AI

Jul 29

Representation Capacity-Matched QNN-SNN Twin Construction for Rate-Encoded SNNs

arXiv:2409. 08290v5 Announce Type: replace-cross Abstract: Spiking Neural Networks (SNNs) promise higher energy efficiency over conventional Quantized Artificial Neural Networks (QNNs) due to their event-driven, spike-based computation.

By Zhanglu Yan, Zhenyu Bai, Kaiwen Tang, Weng-Fai Wong

efficiency

arXiv AI

Aug 7

Ge$^\text{2}$mS-T: Multi-Dimensional Grouping for Ultra-High Energy Efficiency in Spiking Transformer

arXiv:2604. 08894v2 Announce Type: replace-cross Abstract: Spiking Neural Networks (SNNs) offer superior energy efficiency over Artificial Neural Networks (ANNs).

By Zecheng Hao, Shenghao Xie, Kang Chen, Wenxuan Liu, Zhaofei Yu, Tiejun Huang

llms benchmarks

One email a morning, machine-written

Related stories

The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

Spike-Aware C++ INT8 Inference for Sparse Spiking Language Models on Commodity CPUs

SymbolicLight V1: Spike-Gated Dual-Path Language Modeling at High Encoder Spike Sparsity

Representation Capacity-Matched QNN-SNN Twin Construction for Rate-Encoded SNNs

Ge$^\text{2}$mS-T: Multi-Dimensional Grouping for Ultra-High Energy Efficiency in Spiking Transformer