arXiv AI

CNN-Transformer with Sigmoid Label for High-Resolution Sub-Degree DOA Estimation

The paper introduces a sigmoid label for deep‑learning based direction‑of‑arrival (DOA) estimation, encoding DOAs as sums of angle‑shifted monotonic sigmoid functions. Using a CNN‑Transformer network trained with this label, the authors achieve sub‑degree accuracy and 1‑degree resolution with a 0.25° grid step, surpassing traditional Gaussian, hard, and BCE labels. Numerical results confirm the sigmoid label’s superior accuracy and resolution over other labeling approaches.

arXiv Machine Learning
Jul 28

Same Predictions, Different Reasons: The Effect of Quantization on Model Explanations

arXiv:2607. 22872v1 Announce Type: new Abstract: Post-training quantization (PTQ) has become a practical solution for deploying deep learning models on resource-constrained edge devices by compressing high-precision floating-point weights into low-precision representations without requiring retraining.

By Kazi Kamruzzaman Rabbi, Md. Zami Al Zunaed Farabe, M. Sohel Rahman
arXiv AI
Jun 2

DAStatFormer: A Hybrid Multibranch Transformer with Statistical Feature Integration for DAS-Based Pattern Recognitions

arXiv:2606. 00081v1 Announce Type: cross Abstract: Distributed Acoustic Sensing (DAS) enables large-scale monitoring through optical fibers, but its high dimensionality and complex spatio-temporal patterns make event classification demanding.

By Michel Dione (CERI SN - IMT Nord Europe), Jerry Lonlac (CERI SN - IMT Nord Europe), H\'el\`ene Louis (CERI SN - IMT Nord Europe), Anthony Fleury (CERI SN - IMT Nord Europe), Stephane Lecoeuche
Hugging Face Trending Papers
Jul 24

Same Predictions, Different Reasons: The Effect of Quantization on Model Explanations

Post-training quantization (PTQ) has become a practical solution for deploying deep learning models on resource-constrained edge devices by compressing high-precision floating-point weights into low-precision representations without requiring retraining. Past research has demonstrated that quantization largely preserves classification accuracy; however, whether it also preserves the model's internal reasoning remains an open question.

arXiv AI
Oct 12

Understanding Transformer-based Vision Models through Inversion

The paper revisits feature inversion via inverse networks, proposing a modular variant that is computationally efficient and can produce more semantically coherent image reconstructions. It applies this method to large‑scale transformer‑based vision models—Detection Transformer, Vision Transformer, Swin Transformer, and Data‑Efficient Image Transformer—examining reconstructions across network depth. The analysis highlights gradual representational changes in Detection and Vision Transformers, systematic differences in preserving contextual shape and fine‑grained details, and varying robustness to color perturbations, while also demonstrating the framework’s broader applicability to other transformer architectures.

By Jan Rathjens, Shirin Reyhanian, David Kappel, Laurenz Wiskott
arXiv AI
Jun 24

From Spatial to Spectral: An Efficient, Frequency-Guided Feature Representation Learner for Small Object Detection

arXiv:2606. 23825v1 Announce Type: cross Abstract: Efficient small object detection is bottlenecked by the inherent feature scarcity of tiny targets, which is further aggravated by operations of spatial-domain detectors that indiscriminately discard critical high-frequency details.

By Yuhan Rui, Shihan Qiao, Yibin Lou, Mingxi Yu, Yutong Wan, Yanqiao Chen, Dongsheng Hou, Zhen Cao, Athena Zhuoming Zhong, Qi Hao
arXiv Computer Vision
Oct 9

MCL: Meta Convolution Layer

The paper introduces the Meta Convolution Layer (MCL), a dynamic convolution approach that models kernels as input‑conditioned high‑order polynomial functions instead of linear mixtures of basis kernels. MCL generates a single adaptive kernel through a structured polynomial meta‑network, improving training stability and expressivity. Experiments show significant accuracy gains on ImageNet, CIFAR, and fine‑grained classification tasks when MCL is added to ResNet, Wide‑ResNet, Swin, and ViT backbones.

By Naim Reza, Md Al Amin, Ho Yub Jung
arXiv AI
Sep 10

TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection

TriCCOT is a tri-part architecture designed for onboard space object detection that balances computational efficiency with robust performance. It combines a convolutional region proposal network, a conformal prediction stage that enlarges bounding boxes with distribution‑free probabilistic coverage, and Aper‑GATES—a hardware‑friendly attention‑based classifier that replaces standard transformer operations with convolutional projections and gating. Experiments on DIOR and VDVRaw datasets show competitive detection accuracy and improved robustness to blur and noise, and the model was fully deployed on a Xilinx Versal VCK190 FPGA without altering the underlying DPU architecture.

By Adrien Dorise, Marjorie Bellizzi, Julia Cohen, St\'ephane May
arXiv Computer Vision
Sep 3

GaLe: memory-efficient Global Approximate and Local Exact features

GaLe is a memory‑efficient technique that allows pretrained neural networks to run on resource‑constrained devices without retraining. It splits feature maps into a local exact component that keeps fine details and a global approximate component that preserves long‑range dependencies, enabling global operations and attention mechanisms typical of hybrid CNN‑transformer models. On ImageNet, GaLe matches exact‑inference accuracy while delivering up to 65% speedup and 90% RAM reduction on a Cortex‑M33, and it works across classification, detection, and generation tasks.

By Alberto Ancilotto, Elisabetta Farella