arXiv Machine Learning

Smart Scissor: Coupling Spatial Redundancy Reduction and CNN Compression for Embedded Hardware

arXiv:2607. 06915v1 Announce Type: cross Abstract: Scaling down the resolution of input images can greatly reduce the computational overhead of convolutional neural networks (CNNs), which is promising for edge AI.

arXiv Computer Vision
Sep 4

ProgResViT: Progressive Resolution and Width for Adaptive Vision Transformers

ProgResViT is an input‑adaptive Vision Transformer that processes images progressively across multiple rounds, starting with a low‑resolution image and a narrow subnetwork and refining the prediction with higher resolution and a wider subnetwork if needed. The method introduces Progress‑Conditioned Soft Gating (PSG) to share a single backbone across rounds while conditioning token fusion and layer outputs on the current round, block, and input resolution. Experiments on DeiT show improved accuracy‑compute trade‑offs compared to adaptive‑width, adaptive‑depth, and dynamic‑token baselines, and the design also benefits self‑supervised DINO representations and downstream semantic segmentation.

By Ali Hojjat, Janek Haberer, Olaf Landsiedel
arXiv Machine Learning
Sep 7

From Deep to Shallow: Unconstrained and Efficient Layer Merging Strategy

The paper proposes a new strategy for merging layers in deep neural networks, enabling depth compression without requiring an analytical solution for convolutions with padding and without increasing kernel size. This approach addresses limitations of previous methods that struggled with padded convolutions and larger kernels, and it is validated across various architectures and datasets with measured inference speed-ups on embedded platforms.

By Petro Shulzhenko, Gabriele Spadaro, Enzo Tartaglione
arXiv Computer Vision
4d ago

Look Closer: Patch-wise Supervision for AI-Generated Image Detection

The paper investigates patch‑wise supervision for detecting AI‑generated images, proposing a shared backbone that classifies explicit crops with individual losses and averages patch probabilities only during inference. This approach eliminates the need for handcrafted residual filtering or learned image‑level fusion modules. Experiments across single‑patch selection, multiple generator collections, and four CNN and Transformer backbones show that patch‑wise variants outperform whole‑image counterparts on the GenImage dataset, while also exploring factors such as supervision granularity, source resolution, crop size, and inference coverage.

By Zhida Zhang, Tao Wu, Siyu Liu, Jie Cao