Vision Transformers on the Edge: A Comprehensive Survey of Model Compression and Acceleration Strategies
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2606. 31938v1 Announce Type: cross Abstract: Deploying Vision Transformer (ViT) models on edge platforms remains challenging due to their high computational demands and the architectural heterogeneity of modern hybrid ViT models, which incorporate both fully connected and convolutional layers.
arXiv:2607. 09063v1 Announce Type: new Abstract: Edge devices are increasingly utilized for deploying deep learning applications on embedded systems.
EdgeCrafter presents a compact Vision Transformer framework tailored for edge dense prediction tasks such as object detection, instance segmentation, and human pose estimation. By employing task-specialized distillation and an edge-friendly encoder-decoder design, the ECDet backbone achieves 51.7 box AP with under 10 M parameters, while its extensions reach 48.4 mask AP and 74.8 keypoint AP using only COCO annotations. Pretraining on Objects365 further boosts performance, demonstrating that lightweight ViTs can compete with CNN-based models on resource-constrained devices.
arXiv:2607. 06982v1 Announce Type: cross Abstract: Convolutional neural networks (CNNs) have demonstrated encouraging results in image classification tasks.
TEE-X is a TEE‑aware acceleration framework designed to run large vision models, such as Vision Transformers, entirely within Trusted Execution Environments. It introduces a sensitivity‑aware modularization technique and vectorization to overcome memory constraints and latency challenges on edge devices. The framework is validated on OP‑TEE for Arm TrustZone and optimized for the NVIDIA Jetson AGX Xavier, achieving GPU‑level inference latency with minimal accuracy‑latency trade‑offs.
arXiv:2607. 16297v1 Announce Type: cross Abstract: Edge intelligence systems, the intersection of edge computing and artificial intelligence (AI), are pushing the frontier of AI applications.