arXiv Machine Learning

No Frames, Just Frequencies: Bandwidth-Efficient Deployment-Time Adaptation for Smart Glasses

The paper introduces "No Frames, Just Frequencies," a bandwidth‑efficient adaptation framework for smart glasses that uses on‑device frequency descriptors instead of camera frames to detect distribution shifts. These descriptors are sent to a host device, which generates out‑of‑distribution data and adapts a model replica via a predefined protocol. Experiments on ImageNet‑C corruptions, Visual Wake Words, and MS‑COCO show that descriptor‑driven adaptation recovers 93‑95% of supervised oracle gains, with graceful degradation as descriptor resolution drops, enabling up to 784× bandwidth savings.

arXiv Computer Vision
Oct 9

RT-DETRv4: Painlessly Furthering Real-Time Object Detection with Vision Foundation Models

RT-DETRv4 introduces a cost‑effective distillation framework that leverages Vision Foundation Models to improve lightweight real‑time object detectors. The method uses a Deep Semantic Injector to embed high‑level VFM representations into deep detector layers and a Gradient‑guided Adaptive Modulation strategy to adjust semantic transfer intensity based on gradient norms. These techniques yield consistent performance gains across DETR‑based models without adding inference overhead, achieving state‑of‑the‑art COCO AP scores at high FPS.

By Zijun Liao, Yian Zhao, Xin Shan, Yu Yan, Chang Liu, Lei Lu, Xiangyang Ji, Jie Chen
arXiv Machine Learning
Sep 3

FORGE: Forward-Only Test-Time Adaptation for Integer-Only Vision Models on Microcontrollers

FORGE is a forward‑only test‑time adaptation technique designed for integer‑only vision models running on microcontrollers. It restores batch‑normalization statistics after BN folding by re‑normalizing each convolution’s per‑channel output using only forward‑pass estimates, enabling adaptation on deployed, folded integer models. The method achieves accuracy gains comparable to gradient‑based TENT, requires adapting only a few layers, works with single‑sample streaming, and has been validated on an ESP32‑S3 with minimal energy and latency overhead.

By Muhammad Rehan, Haider Ali, Muhammad Ali Munir, Moaz Amjad
arXiv Computer Vision
Aug 24

Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directions

The paper surveys Continual Test-Time Adaptation (CTTA), a framework that adapts pretrained computer‑vision models to non‑stationary target distributions without source data or labeled targets, while avoiding catastrophic forgetting and error accumulation. It formally defines the CTTA problem, categorizes existing methods into optimization‑based, parameter‑efficient, and architecture‑based families, and reviews representative techniques and benchmarks across standard evaluation settings. The survey also outlines current limitations and proposes future research directions, such as adapting foundation models and black‑box systems.

By Sarthak Kumar Maharana, Shambhavi Mishra, Yunbei Zhang, Shuaicheng Niu, Taki Hasan Rafi, Jihun Hamm, Marco Pedersoli, Jose Dolz, Yunhui Guo
arXiv Machine Learning
Aug 4

AdaDINO: Context-Adaptive DINO-Distilled Vision Foundation Models for Efficient Open-Vocabulary Edge Inference

arXiv:2604. 15622v3 Announce Type: replace-cross Abstract: Always-on contextual AI runs language-aligned vision foundation models (VFMs) on edge devices, where the on-device model is the dominant continuous compute cost under strict latency and power limits.

By Yiwei Zhao, Yi Zheng, Huapeng Su, Jieyu Lin, Stefano Ambrogio, Cijo Jose, Michael Ramamonjisoa, Patrick Labatut, Barbara De Salvo, Chiao Liu, Phillip B. Gibbons, Ziyun Li
arXiv Computer Vision
Sep 3

Test-Time Logit Prompting for Source-Free Missing Modality Adaptation

The paper introduces Test-Time Logit Prompting (TLP), a lightweight framework that adapts vision-language models to missing-modality inputs without accessing source training data. TLP optimizes logit prompts using uncertainty-aware adjustments and modality-complete consistency regularization, thereby maintaining prediction confidence and semantic consistency. Experiments on various benchmarks show that TLP improves recognition performance by up to 8% while requiring only a few hundred tunable parameters and minimal test-time optimization steps.

By Taixi Chen, Nancy Guo
arXiv Machine Learning
Jul 28

Same Predictions, Different Reasons: The Effect of Quantization on Model Explanations

arXiv:2607. 22872v1 Announce Type: new Abstract: Post-training quantization (PTQ) has become a practical solution for deploying deep learning models on resource-constrained edge devices by compressing high-precision floating-point weights into low-precision representations without requiring retraining.

By Kazi Kamruzzaman Rabbi, Md. Zami Al Zunaed Farabe, M. Sohel Rahman
arXiv Computer Vision
Oct 28

SAGE: Saliency-Annealed Gated Encoder for Universal Vision Recognition

SAGE (Saliency‑Annealed Gated Encoder) is a Vision Transformer‑based backbone that explicitly leverages saliency, global context, and high‑frequency details through a saliency‑guided architecture, an annealing training paradigm, and a two‑stage loss transition. It achieves state‑of‑the‑art or competitive results on a wide range of dense prediction tasks, including COCO object detection and segmentation, ADE20K segmentation, TinyImageNet classification, and DIOR‑R oriented detection, all using the same backbone with task‑specific decoders. The framework is notable for being the first to deliver multi‑task SOTA performance on Huawei Ascend NPUs.

By Le Yang, Yucheng Huang, Junyu Chen, Qi Dang, Xin Kong, Haifeng Huo, Qiang Zhao