arXiv AI

PairCLIP-SWA: Similarity-Guided Balancing and Stochastic Weight Averaging for Generalized Deepfake Image Detection with OpenCLIP

PairCLIP‑SWA is a single‑backbone deepfake detector that fine‑tunes an OpenCLIP ViT‑L/14 visual tower using a class‑balanced corpus created by CLIP‑similarity‑guided subsampling and then applies stochastic weight averaging over the fine‑tuning trajectory. Trained on the IEEE SP Cup 2025 (DF‑Wild‑Cup) benchmark, the weight‑averaged model achieves 97.04 % accuracy, 98.64 % AU‑ROC and a 4.07 % equal error rate—outperforming the best published three‑backbone ensemble. The study shows that averaging stabilizes validation performance, prevents misranking on disjoint test sets, and that CLIP pre‑training, rather than ensembling, is the key driver of accuracy.

arXiv Machine Learning
Jul 31

DS@GT ARC at ImageCLEFmedical 2026: Architectural Diversity for Concept Detection and Foundation-Model Scaling for Caption Prediction in Medical Image Analysis

arXiv:2607. 27763v1 Announce Type: cross Abstract: We describe the DS@GT submissions to the ImageCLEFmedical Caption 2026 challenge, which continues a long-running benchmark on the ROCOv2 dataset with two tracks: Concept Detection (Task 1), assigning UMLS Concept Unique Identifiers (CUIs) to radiology images, and Caption Prediction (Task 2), generating natural-language captions.

By Bowen Wang, Youwen Zhang, Ritesh Mehta
Hugging Face Trending Papers
Jul 30

DS@GT ARC at ImageCLEFmedical 2026: Architectural Diversity for Concept Detection and Foundation-Model Scaling for Caption Prediction in Medical Image Analysis

We describe the DS@GT submissions to the ImageCLEFmedical Caption 2026 challenge, which continues a long-running benchmark on the ROCOv2 dataset with two tracks: Concept Detection (Task 1), assigning UMLS Concept Unique Identifiers (CUIs) to radiology images, and Caption Prediction (Task 2), generating natural-language captions. For Task 1, our primary submission was a three-way late-fusion ensemble of ConvNeXt-V2, BiomedCLIP ViT-B/16, and DenseNet-169 with a regularized ''Honest Threshold Tuning'' procedure designed to avoid validation overfitting on rare concepts; this submission ranked first on the official submission with a primary $F_1$ of $0.

arXiv AI
6d ago

How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study

The study evaluates 16 AI‑generated image detection methods in a zero‑shot setting, testing 23 pretrained variants on 12 datasets with 2.6 million images from 291 generators. Results show no single detector consistently outperforms others, with accuracy ranging from 37.5 % to 75.0 %. The study highlights that training data alignment and generator type significantly affect performance, especially against modern commercial models, and identifies systematic failure patterns across datasets.

By Simiao Ren (Neo), Yuchen Zhou (Neo), Xingyu Shen (Neo), Kidus Zewde (Neo), Tommy Duong (Neo), George Huang (Neo), Hatsanai (Neo), Tiangratanakul (Dennis), Tsang (Dennis), Ng (Dennis), En Wei, Jiayu Xue
arXiv Machine Learning
Jul 14

A Strong Balanced-Softmax Classifier-Retraining Baseline for Long-Tailed Recognition

arXiv:2607. 09832v1 Announce Type: new Abstract: Long-tailed recognition methods often modify losses, margins, or representations to reduce the dominance of frequent classes.

By Juan Terven, Diana Margarita C\'ordova Esparza, Julio Alejandro Romero Gonzalez, Edgar Arturo Ch\'avez Urbiola, Francisco Javier Willars Rodriguez, Juan Bautista Hurtado Ramos, Alfonso Ramirez Pedraza
arXiv Machine Learning
Oct 23

GM-GReFEL: Geometry-Guided Spatiotemporal State-Space Learning for Robust Dynamic Facial Expression Recognition

GM-GReFEL is a geometry‑guided spatiotemporal state‑space network for dynamic facial expression recognition that replaces a Vision Transformer with a Modulated GroupMamba backbone, reducing self‑attention cost to linear time. It incorporates a reliability module that mixes classifier outputs with geometric anchor votes based on prediction entropy, and is trained via a Triple Loss after static‑to‑dynamic weight transfer. In five‑fold cross‑validation it achieves competitive UAR/WAR scores on DFEW, MAFW, and FERV39k, with modest temporal modeling benefits and latency comparable to ViT‑B/16.

By Yudhistira Arditya Pratama, Yi-Zeng Hsieh
arXiv Machine Learning
Aug 27

CropCop: An Auditable 120-Class Plant-Health Model from Benchmark Reconstruction to a Quantised Runtime Artifact

CropCop is a closed‑set plant‑health recognition system covering 120 operational classes, built from a rigorously audited dataset of 109,107 images after removing 3,233 duplicate relationships. The model, based on a fine‑tuned DINOv3 ConvNeXt‑Tiny, achieves 98.51% accuracy and 96.87% macro‑F1 on a locked internal test, while a quantised MobileNetV4 variant reaches 98.46% accuracy and 96.23% macro‑F1 in a 22.60 MiB runtime artifact. Validation‑only post‑training quantisation and a compact ExecuTorch/XNNPACK PTE ensure high fidelity between the trained model and its deployed form, with minimal decision changes between the INT8 graph and the final artifact.

By Rana Muhammad Ahmed, Sabahat Abbas
arXiv Machine Learning
Oct 23

Few-shot Classification as Multi-instance Verification: Effective Backbone-agnostic Transfer across Domains

The paper proposes treating few-shot classification as a series of multiple instance verification (MIV) tasks, enabling effective transfer across domains without fine-tuning the backbone. It introduces the MIV-head, a backbone‑agnostic, computationally efficient classification head that achieves competitive accuracy on cross‑domain few‑shot image classification using frozen, pre‑trained backbones. Experiments on an extended Meta‑Dataset benchmark show that the MIV-head outperforms state‑of‑the‑art adapter methods while incurring lower adaptation cost.

By Xin Xu, Eibe Frank, Geoffrey Holmes
arXiv Machine Learning
Sep 1

Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detection

The study challenges the prevailing belief that frequency-based features and compression-invariant learning are essential for robust deepfake detection. Using a controlled, pre‑registered protocol, a simple EfficientNet‑B0 trained on diverse multi‑quality data outperformed the more complex CAFRL model across all compression levels, with a 3.66 AUC point advantage at CRF 40. After identifying and correcting four experimental defects, the authors found that frequency features added no marginal benefit, while data diversity—particularly real constant‑rate‑factor variants—proved to be the key factor for robustness against H.264 re‑encoding.

By Abbas Aliyev, Samir Rustamov