arXiv Machine Learning July 13, 2026 By Ibrahim Batuhan Akkaya, Kishaan Jeeveswaran, Bahram Zonooz, Elahe Arani

Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers

Read the original on arXiv Machine Learning →

arXiv:2607. 09480v1 Announce Type: cross Abstract: The human visual system (HVS) employs foveated sampling and eye movements to achieve efficient perception, conserving both metabolic energy and computational resources.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision

3d ago

Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models

arXiv:2609.39134v1 Announce Type: new Abstract: Visual-token compression improves the efficiency of large vision-language models, but can expose failures that full-token evaluation misses. We study a...

By Shilinlu Yan, Bowen Chen, Yuechen Zhang, Zhenhong Zhou, Li Sun, Sen Su

llms multimodal safety

arXiv AI

Jul 7

Fusion: A Framework for Unified Sequential Token AdaptatIon in VisiOn TraNsformers

arXiv:2607. 02612v1 Announce Type: cross Abstract: Vision Transformers achieve strong image classification accuracy but process all image regions with nearly the same computation, even when many regions are redundant or uninformative.

By Aravind Pradeep, Samira Nazari, Mahdi Taheri, Christian Herglotz

llms computer-vision efficiency benchmarks

Hugging Face Trending Papers

Aug 5

A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimization

Vision Transformers (ViTs) increasingly rely on input-adaptive inference, such as token pruning and early halting, to meet energy and latency budgets. This survey examines a recent class of adversarial efficiency degradation attacks that target these mechanisms to increase computation without necessarily degrading accuracy.

llms computer-vision efficiency safety

arXiv Machine Learning

Aug 28

Federated Adversarial Training with Transformers

The paper investigates federated adversarial training (AT) for vision transformers, a topic not previously explored in federated learning (FL). It evaluates various transformer architectures and aggregation strategies, and introduces FedWAvg, an extension of FedAvg that weights client updates based on similarity of their last-layer representations. Experiments demonstrate that FedWAvg yields higher robust accuracy than existing aggregation methods in non‑IID settings.

By Ahmed Aldahdooh, Wassim Hamidouche, Olivier D\'eforges

llms computer-vision nlp benchmarks safety

arXiv Machine Learning

Aug 21

Clustering and Token Denoising for Faster and More Robust VLMs

arXiv:2608. 19285v1 Announce Type: cross Abstract: Recent Visual-Language Models (VLMs) have enhanced the capabilities of pre-trained LLMs by adding vision tokens alongside text, with approaches like LLaVA showing impressive results.

By Baptiste Rossigneux, Inna Kucher, Vincent Lorrain, Emmanuel Casseau

llms efficiency multimodal benchmarks

arXiv Computer Vision

Sep 15

Token-Space Mask Prediction for Efficient Vision Transformer Segmentation

arXiv:2605.18177v2 Announce Type: replace Abstract: Query-based Vision Transformer segmentation models typically reconstruct dense spatial feature maps to predict masks, inheriting design patterns fr...

By Calvin Galagain, Martyna Poreba, Fran\c{c}ois Goulette

llms computer-vision