arXiv Machine Learning June 16, 2026 By Leyla Naz Candogan, Arshia Afzal, Pol Puigdemont, Volkan Cevher

Spatial Priors via Space Filling Curves for Small and Limited Data Vision Transformers

Read the original on arXiv Machine Learning →

arXiv:2606. 14757v1 Announce Type: cross Abstract: Though Vision Transformers (ViTs) have become the dominant backbone in many computer vision tasks, due to permutation equivariance, their attention mechanism lacks explicit spatial inductive biases.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Sep 2

HiLRP: Toward One Trustworthy Explanation for Vision Transformer: Conservation-Valid Attribution via Attention Primitives

HiLRP introduces a unified attribution framework for Vision Transformers (ViTs) that addresses the challenges posed by diverse architectural designs. By decomposing ViT operations into four basic types—linear maps, bilinear mixing, normalization/gating, and reindexing—HiLRP applies conservation‑satisfying relevance rules, enabling reliable explanations across a wide range of backbones. The method outperforms 14 existing attribution techniques on 10 architectures, maintaining conservation and improving localization accuracy (0.97 Pointing) compared to competitors.

By Sathiyamohan Nishankar, Pubudu Sanjeewani, Asanka Perera, Selvarajah Thuseethan

llms computer-vision

arXiv Computer Vision

2d ago

Subtoken Vision Transformer for Fine-grained Recognition

arXiv:2607.09086v2 Announce Type: replace Abstract: We present Subtoken Vision Transformer (SubViT), a selective image tokenization method for fine-grained visual recognition. Standard Vision Transfo...

By Jie Zhu, Ivy Zhang, Minchul Kim, Xiaoming Liu

llms computer-vision nlp

arXiv AI

2d ago

VETO: Video Efficient Token Optimization for Vision Language Models

arXiv:2610.01785v1 Announce Type: cross Abstract: Processing long videos with Vision-Language Models (VLMs) is bottlenecked by the quadratic cost of visual tokens, making long-form inference prohibit...

By Gueter Josmy Faure, Hao Ping Wang, Min-Hung Chen, Winston H. Hsu

llms multimodal

arXiv AI

Jun 30

ScAle: Attention Head Scaling as a Minimal Adapter for Spatial Reasoning in Vision Language Models

arXiv:2606. 29579v1 Announce Type: cross Abstract: Spatial reasoning remains a persistent challenge for many vision language models (VLMs), and improving it typically requires fine-tuning with substantial additional parameters.

By Rahul Chowdhury, Timothy A Rupprecht, Xuan Shen, Pu Zhao, Yanzhi Wang

llms fine-tuning benchmarks

arXiv Machine Learning

Jun 4

Spatially Grounded Concept Bottleneck Models via Part-Factorized Attention

arXiv:2606. 04364v1 Announce Type: cross Abstract: Concept bottleneck models (CBMs) predict a layer of human-named attributes before predicting a class, which makes their decisions auditable.

By Dhanesh Ramachandram

llms computer-vision

arXiv Computer Vision

2d ago

Do Vision Transformers Need All-to-All Attention? Global Communication Through Elastic Learned Cores

arXiv:2605.12491v2 Announce Type: replace Abstract: Vision Transformers (ViTs) learn rich visual-semantic representations through all-to-all self-attention among patch tokens. However, this design im...

By Alan Z. Song, Yinjie Chen, Mu Nan, Deva Ramanan, Michael J. Tarr, Andrew F. Luo

llms computer-vision benchmarks

One email a morning, machine-written

Related stories

HiLRP: Toward One Trustworthy Explanation for Vision Transformer: Conservation-Valid Attribution via Attention Primitives

Subtoken Vision Transformer for Fine-grained Recognition

VETO: Video Efficient Token Optimization for Vision Language Models

ScAle: Attention Head Scaling as a Minimal Adapter for Spatial Reasoning in Vision Language Models

Spatially Grounded Concept Bottleneck Models via Part-Factorized Attention

Do Vision Transformers Need All-to-All Attention? Global Communication Through Elastic Learned Cores