arXiv AI
Later Is Better: Token Reduction for ViTs Under Distribution Shift
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 7
Fusion: A Framework for Unified Sequential Token AdaptatIon in VisiOn TraNsformers
arXiv:2607. 02612v1 Announce Type: cross Abstract: Vision Transformers achieve strong image classification accuracy but process all image regions with nearly the same computation, even when many regions are redundant or uninformative.
arXiv Computer Vision
6d ago
PrePARE: Pre-AA Token Pruning for Frozen Multi-View Geometry Transformers
arXiv:2605.08371v2 Announce Type: replace Abstract: Multi-view geometry transformers are feed-forward 3D foundation models that jointly predict depth maps, point maps, and camera poses for N images i...
arXiv AI
23h ago
Test-Time Adaptation of Quantized ViTs via Single-Pass Quantizer-Aligned Recalibration
The paper introduces Quantizer‑Aligned Recalibration (QuAR), a single‑pass test‑time adaptation technique for quantized vision transformers that does not require backpropagation or parameter updates. QuAR recalibrates activations at the input of frozen quantizers by aligning per‑channel statistics with the source calibration, thereby correcting the distorted code distribution caused by distribution shift. On ImageNet‑C, QuAR outperforms state‑of‑the‑art backprop‑free methods across 3‑, 4‑, 6‑, and 8‑bit precisions, achieving higher accuracy, lower latency, and minimal memory overhead while maintaining performance across diverse shift scenarios.
arXiv AI
Jul 7
Rethinking Depth Pruning for Vision Transformers: A Heterogeneity-Aware Perspective
arXiv:2607. 03784v1 Announce Type: cross Abstract: While prior studies have successfully compressed vision Transformers (ViTs) through various pruning techniques, most have concentrated on width pruning to achieve significant reductions in model size.
arXiv AI
Jul 24
Benchmarking Unlearning for Vision Transformers
arXiv:2602. 20114v2 Announce Type: replace-cross Abstract: Machine unlearning (MU) refers to the post-training capability to remove (the influence of) training examples that are incorrect, biased, or leak sensitive/private information.
arXiv Machine Learning
Sep 3
FORGE: Forward-Only Test-Time Adaptation for Integer-Only Vision Models on Microcontrollers
FORGE is a forward‑only test‑time adaptation technique designed for integer‑only vision models running on microcontrollers. It restores batch‑normalization statistics after BN folding by re‑normalizing each convolution’s per‑channel output using only forward‑pass estimates, enabling adaptation on deployed, folded integer models. The method achieves accuracy gains comparable to gradient‑based TENT, requires adapting only a few layers, works with single‑sample streaming, and has been validated on an ESP32‑S3 with minimal energy and latency overhead.