Hugging Face Trending Papers

Parameter Efficient Continual Learning for Sparse Event-Based Transformers

Read the original on Hugging Face Trending Papers →

The paper introduces sLoTh, a parameter‑efficient continual learning framework for sparse event‑based vision transformers. By freezing the backbone and limiting plasticity to low‑rank attention updates (seLoRA) and shared neuronal threshold modulation, sLoTh adapts to new tasks while updating less than 1% of the parameters and avoiding replay buffers. Experiments on CIFAR‑100, Tiny‑ImageNet, ImageNet‑100, and ImageNet‑R show competitive rehearsal‑free performance across up to 100 tasks and achieve roughly 6.5× lower energy consumption than dense vision transformers.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Computer Vision
Aug 28

Parameter Efficient Continual Learning for Sparse Event-Based Transformers

The paper introduces sLoTh, a parameter‑efficient continual learning framework for sparse event‑based vision transformers. sLoTh freezes the backbone and limits plasticity to low‑rank attention updates (seLoRA) and shared neuronal threshold modulation, updating less than 1% of parameters without replay buffers. Experiments on CIFAR‑100, Tiny‑ImageNet, ImageNet‑100, and ImageNet‑R show competitive rehearsal‑free performance across up to 100 tasks while achieving roughly 6.5× lower energy consumption than dense vision transformers.

By Vaishnavi Nagabhushana, Kartikay Agrawal, Ayon Borthakur
arXiv Computation and Language
Oct 1

Spike-driven Vision-Language-Action Model

arXiv:2609.39514v1 Announce Type: new Abstract: Vision-language-action (VLA) models bridge multimodal understanding and robotic control, advancing the dominant paradigm for embodied intelligence. How...

By Shuai Wang, Malu Zhang, Mingquan Liu, Weihui Dai, Dehao Zhang, Jieyuan Zhang, Yimeng Shan, Zijian Zhou, Yang Yang
Hugging Face Trending Papers
Jun 1

Beyond Low-Rank: Low-Rank Sparse Prompting via Spiking Neural Network and Prompt Factorization

Visual Prompting (VP) has emerged as an efficient paradigm for adapting large-scale pre-trained vision models to downstream tasks by incorporating learnable prompts at the input level. However, existing VP methods typically employ dense pixel-level prompts, which often suffer from redundant perturbations, limited generalization and energy inefficiency.

arXiv Machine Learning
5d ago

Local Timescale Gates for Timescale-Robust Continual Spiking Neural Networks

Local Timescale Gating (LT‑Gate) is a neuron model that tracks fast and slow information in parallel and uses a learned gate to adjust their influence, enabling spiking neurons to preserve long‑term context while responding quickly. The approach includes a variance‑tracking regularization inspired by biological homeostasis and operates with local updates, making it compatible with neuromorphic hardware such as Intel’s Loihi chip. Empirical results show LT‑Gate improves accuracy and retention on sequential learning tasks, achieving about 51 % final accuracy versus 46 % for a recent Hebbian baseline and outperforming prior SNN methods.

By Devansh Deep, Ansh Tiwari, Ayush Chauhan