← Back to all news
arXiv Computer Vision By Yehan De Silva, Anirudh Sridhar, Armin Lotfy, Nafiseh Kahani, Yvan Labiche, Ziyu Wang, Frank Ouyang, Clare Carty, Azalia Shamsaei

Image Augmentation as Test Generation for Deep Learning-Based Image Retrieval Systems

Read the original on arXiv Computer Vision →

The paper reviews 50 image augmentation and generation techniques, categorizing them into ten groups, and conducts a large‑scale empirical study to assess their effectiveness as test generators for embedding‑based image retrieval systems. Using Amazon Titan and OpenCLIP embeddings, the authors evaluate the techniques across four dimensions—embedding‑space similarity, embedding uncertainty, semantic realism, and retrieval failure rate—on CIFAR‑10, ImageNet‑1K, and an industrial dataset. Results show that weather simulation and SaSPA yield the highest uncertainty and failure rates while maintaining realistic visuals, whereas GAN‑based methods produce low realism due to synthetic artifacts.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Oct 12

Improving Semantic Coverage in AI Test & Evaluation through Generative Augmentation

The paper introduces a three‑stage generative AI pipeline to identify and fill semantic gaps in AI test datasets without requiring labeled data. First, vision‑language models zero‑shot label semantic factors and clustering highlights those most impacting model behavior. Second, diffusion‑based image‑to‑image models generate new images that preserve scene content while adding underrepresented semantics. Third, statistical checks confirm improved coverage before the synthetic images augment the test set. The method is validated on image classification and object detection tasks, showing that enriched test sets better differentiate models with or without exposure to missing semantics, leading to conclusions that align more closely with an ideally covered dataset.

By Connor Hashemi, Bharadwaj Ravichandran, Connor Anderson, Shitij Govil, Brandon RichardWebster, Brian Hu, Keith Fieldhouse
llmsragdiffusioncomputer-visionmultimodal
More like this →
Hugging Face Trending Papers
Jun 23

Benchmarking the Alignment of Data-Quality Metrics, Human Judgment and Land-Cover Segmentation Performance for Earth Observation

Volume and quality of datasets are crucial for deep learning model training, yet they are often constrained by availability and data acquisition costs. Synthetic data augmentation can extend existing datasets with realistic images, and the quality of these images is generally assessed through fidelity metrics such as FID, KID, IS, LPIPS and SSIM that measure structural or distributional similarity.

computer-visionbenchmarkssafety
More like this →