arXiv AI

A Generative AI Integrated Multimodal Framework for Low-Latency Multi-Camera Person Re-Identification

arXiv AI
Oct 16

ReText: Text Boosts Generalization in Image-Based Person Re-identification

ReText is a method that enhances image-based person re-identification by incorporating textual descriptions into training. The authors augment existing multi-camera datasets with captions generated by a fine‑tuned Vision‑Language Model and train the system on three tasks: Re-ID, image‑text matching, and image reconstruction guided by text. Experiments show that ReText improves generalization across unseen domains and outperforms current state‑of‑the‑art approaches on cross‑domain Re‑ID benchmarks.

By Timur Mamedov, Karina Kvanchiani, Anton Konushin, Vadim Konushin
arXiv Machine Learning
1d ago

Analyzing the Optimization Conflict Between Image- and Text-Based Person Re-Identification

The paper investigates the conflict between image‑based (I2I) and text‑based (T2I) person re‑identification objectives when trained on a shared vision encoder. It shows that optimizing both simultaneously degrades performance because I2I contracts intra‑identity distances while T2I preserves them. A two‑stage pipeline—first training the encoder for I2I invariance and then freezing it while aligning the text encoder—improves T2I results, suggesting a path toward unified ReID systems.

By Karina Kvanchiani, Timur Mamedov
arXiv Computer Vision
Oct 21

In PRAISE of Attributes: Grounding Retrieval Geometry with Query-Conditioned Subspaces for Person Re-Identification

The paper introduces PRAISE, a test‑time adaptation framework for vision‑language model based person re‑identification. PRAISE constructs an Attribute‑Conditioned Subspace (ACS) from a bank of attribute prompts, reshaping query‑gallery affinities without requiring identity or attribute labels. Experiments on image‑to‑image and text‑to‑image ReID benchmarks show that PRAISE consistently improves retrieval performance over existing backbones and TTA baselines.

By Rajarshi Bhattacharya, Aryan Shukla, Shakeeb Murtaza, Christian Desrosiers, Jose Dolz, Maguelonne Heritier, Eric Granger
arXiv Machine Learning
Jun 9

Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study

arXiv:2606. 09362v1 Announce Type: cross Abstract: Re-Identification (ReID) in autonomous driving is typically formulated as a visual matching problem, where observations of vehicles, pedestrians, and cyclists are associated across time, frames, or camera views using learned appearance embeddings, often complemented by motion, geometric, or multimodal cues.

By Eduardo Borges, Manuel Abreu, Lu\'is Garrote, Urbano J. Nunes
arXiv Computer Vision
Sep 25

Long-Tail Adaptive Flow Matching with Explicit Conditional Consistency Guidance for Precise Multimodal Face Synthesis

The paper introduces EC²Face, a multimodal face synthesis framework that enhances semantic alignment by combining Explicit Conditional Consistency Guidance (ECCG) and Long‑Tail Adaptive Flow Matching (LAFM). ECCG enforces pixel‑level consistency between generated faces, textual descriptions, and semantic masks, while a temporal dynamic modulation adjusts supervision strength over diffusion timesteps. LAFM reweights spatial optimization signals according to attribute frequency, improving rare attribute synthesis without adding inference overhead. Experiments demonstrate that EC²Face outperforms baselines, achieving a 29.38% improvement in mask accuracy for rare attributes.

By Yushe Cao, Xuechao Zou, Xing Xi, Dianxi Shi, Chun Yu, Junliang Xing
arXiv AI
Oct 16

UniFGVC: Universal Training-Free Few-Shot Fine-Grained Vision Classification via Attribute-Aware Multimodal Retrieval

UniFGVC introduces a training‑free framework for few‑shot fine‑grained visual classification that reframes the task as a multimodal retrieval problem. It uses a Category‑Discriminative Visual Captioner to generate attribute‑aware textual descriptions, then matches image‑description pairs with category templates via pre‑trained encoders. Experiments on 12 datasets show that UniFGVC consistently outperforms existing CLIP‑based and fully‑supervised MLLM methods, demonstrating the effectiveness of the retrieval paradigm.

By Haiyun Guo, Hongyu Guo, Xiangzhao Hao, Jiarui Guo, Jinqiao Wang, Tat-Seng Chua
Hugging Face Trending Papers
Jun 1

Towards Resolving Optimization Conflicts Between Image- and Text-Based Person Re-Identification

The joint optimization of image-based (I2I) and text-based (T2I) person re-identification (ReID) is hindered by modality discrepancies and conflicting training objectives, leading to suboptimal shared representations. While I2I ReID focuses on identity-level invariance across images of the same person, T2I ReID is driven by instance-specific textual descriptions tied to unique visual traits.