arXiv AI

APEX: Assumption-free Projection-based Embedding eXamination Metric for Image Quality Assessment

APEX is a new image quality assessment framework that eliminates assumptions by using the Sliced Wasserstein Distance as a similarity measure. It is embedding‑agnostic, scalable to high‑dimensional spaces, and employs open‑vocabulary models CLIP and DINOv2 for feature extraction. Benchmarks show that APEX is more robust to visual degradations and remains stable across different datasets, including out‑of‑domain ones.

Hugging Face Trending Papers
Jun 23

Benchmarking the Alignment of Data-Quality Metrics, Human Judgment and Land-Cover Segmentation Performance for Earth Observation

Volume and quality of datasets are crucial for deep learning model training, yet they are often constrained by availability and data acquisition costs. Synthetic data augmentation can extend existing datasets with realistic images, and the quality of these images is generally assessed through fidelity metrics such as FID, KID, IS, LPIPS and SSIM that measure structural or distributional similarity.

arXiv Computer Vision
Aug 31

Image Augmentation as Test Generation for Deep Learning-Based Image Retrieval Systems

The paper reviews 50 image augmentation and generation techniques, categorizing them into ten groups, and conducts a large‑scale empirical study to assess their effectiveness as test generators for embedding‑based image retrieval systems. Using Amazon Titan and OpenCLIP embeddings, the authors evaluate the techniques across four dimensions—embedding‑space similarity, embedding uncertainty, semantic realism, and retrieval failure rate—on CIFAR‑10, ImageNet‑1K, and an industrial dataset. Results show that weather simulation and SaSPA yield the highest uncertainty and failure rates while maintaining realistic visuals, whereas GAN‑based methods produce low realism due to synthetic artifacts.

By Yehan De Silva, Anirudh Sridhar, Armin Lotfy, Nafiseh Kahani, Yvan Labiche, Ziyu Wang, Frank Ouyang, Clare Carty, Azalia Shamsaei
arXiv Machine Learning
Aug 5

Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation

arXiv:2608. 03990v1 Announce Type: new Abstract: Synthetic histopathology image generation has emerged as an approach that may address data scarcity in computational pathology, yet current evaluation methodologies may not fully assess synthetic data quality for medical applications.

By Seyed Kahaki, Shijie Li, Weijie Chen, Nicholas Petrick
arXiv Computer Vision
Oct 16

Auditing Metrics for Synthetic Data Utility: A Cross-Domain Study of Appearance and Geometry

The paper introduces SADGE, a quantitative similarity metric that predicts how well synthetic image datasets will perform on real-world computer vision tasks without requiring downstream model training. SADGE combines appearance and geometric similarity measures through a constrained bilinear interaction, outperforming appearance-only and geometry-only baselines across 79,000 image pairs in five synthetic-to-real benchmark families. The study demonstrates that the non‑linear interplay between appearance and geometry, rather than either alone, best predicts downstream performance in tasks such as object detection, semantic segmentation, and pose estimation.

By Patryk Bartkowiak, Dominik Michels, Soren Pirk, Wojtek Palubicki
arXiv Machine Learning
Oct 16

Stabilizing the Modality Gap: Null-Space Projected Continual Learning for Vision-Language Models

The paper introduces FPCD, a framework that stabilizes the modality gap in vision‑language models during continual learning. It combines Fast Null‑space Projection, which projects gradients onto approximate null spaces to reduce interference, with Contrastive Distillation that aligns image‑to‑text and text‑to‑image similarity distributions using a small reference set. On the 11‑task MTIL benchmark, FPCD achieves strong performance, maintaining stable modality gaps and superior zero‑shot retrieval on COCO Captions and Flickr30k.

By Tiantian Peng, Yuyang Liu, Shuo Yang, Qiuhe Hong, YongHong Tian