arXiv:2609.16656v1 Announce Type: new Abstract: State space models (SSMs), particularly Mamba, have emerged as efficient alternatives to attention-based architectures and have been extended to vision...
arXiv:2508.03351v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated remarkable capabilities across diverse language tasks, motivating their extension to vision-la...
arXiv:2607. 06600v1 Announce Type: cross Abstract: Line segment detection is a key building block in visual SLAM, 3D reconstruction, and industrial inspection.
arXiv:2512. 08240v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) rely on hundreds of visual tokens, leading to high computational and memory costs.
arXiv:2610.16261v1 Announce Type: new Abstract: Mamba-based super-resolution models are efficient alternatives to Transformer-based restoration backbones, but their low-bit post-training quantization...
arXiv:2509. 10334v2 Announce Type: replace-cross Abstract: Vision Transformers (ViTs) have recently achieved strong results in semantic segmentation, yet their deployment on resource-constrained devices remains limited due to their high memory footprint and computational cost.
VQ-Transplant is a framework that allows new vector‑quantization (VQ) modules to be inserted into frozen, pre‑trained visual tokenizers without retraining the entire model. By preserving all encoder‑decoder parameters and adding a lightweight decoder adaptation trained for only five epochs on ImageNet‑1k, the method mitigates decoder‑quantization mismatch. Experiments show that VQ-Transplant achieves near state‑of‑the‑art reconstruction fidelity for industry‑level models such as VAR while cutting training costs by 95%.
arXiv:2610.15092v1 Announce Type: cross Abstract: Quantization plays a crucial role in efficiently deploying deep learning models on resource-constrained devices. Post-training quantization does not...
SCULPT is a training-time method that enhances the readiness of edge vision models for low-bit post‑training quantization (PTQ). It introduces a topology‑aware activation regularizer to reduce skewness and kurtosis, and a stable percentile‑based clipping mechanism that learns deployment‑ready activation bounds during ordinary FP32 fine‑tuning. The resulting clipping bounds can be directly exported into standard PTQ workflows for INT8 or lower‑bit settings such as W4A8.
VisionMX introduces a post‑training microscaling (MX) quantization technique for vision models, addressing three key error sources identified in direct conversion: block‑scale representation, misalignment of small convolutional weight tensors, and underuse of signed codes for nonnegative activations. The method optimizes bounded weight rounding and incorporates a foldable affine correction for activations, improving performance across image classification, object detection, semantic segmentation, and low‑light image enhancement tasks. VisionMX outperforms direct conversion and other post‑training quantization baselines, especially in architectures most sensitive to MX conversion.
Pixels to Tokens introduces TEAL, a token‑space efficient active learning framework that operates at the pixel level for semantic segmentation using a frozen Vision Transformer backbone. TEAL selects diverse candidate pixels via a two‑level MaxHerding strategy on multi‑layer token descriptors and refines uncertainty on a finer decoder grid, avoiding interpolation artifacts. Across multiple datasets, TEAL outperforms prior baselines under extreme label scarcity, achieving up to +24.36 mIoU with a single labeled pixel per image and reaching 97% of fully supervised performance with only ten pixels.
PACE introduces a training‑free Condense‑and‑Extract framework that speeds up Vision‑Language Model inference by first adaptively downsampling visual inputs before encoding and then selectively retaining essential tokens during decoding. The Adaptive Pixel Compressor (APC) reduces encoder workload while preserving global context, and the Dynamic Dual‑Attention Extractor (DDAE) keeps task‑critical details by fusing visual and language signals. Applied to Qwen2.5‑VL‑7B, PACE maintains 93.8% of performance using only 10% of visual tokens, achieving a 3.1× speedup in time to first token.