arXiv Machine Learning

Analyzing the Optimization Conflict Between Image- and Text-Based Person Re-Identification

The paper investigates the conflict between image‑based (I2I) and text‑based (T2I) person re‑identification objectives when trained on a shared vision encoder. It shows that optimizing both simultaneously degrades performance because I2I contracts intra‑identity distances while T2I preserves them. A two‑stage pipeline—first training the encoder for I2I invariance and then freezing it while aligning the text encoder—improves T2I results, suggesting a path toward unified ReID systems.

Hugging Face Trending Papers
Jun 1

Towards Resolving Optimization Conflicts Between Image- and Text-Based Person Re-Identification

The joint optimization of image-based (I2I) and text-based (T2I) person re-identification (ReID) is hindered by modality discrepancies and conflicting training objectives, leading to suboptimal shared representations. While I2I ReID focuses on identity-level invariance across images of the same person, T2I ReID is driven by instance-specific textual descriptions tied to unique visual traits.

arXiv AI
Oct 16

ReText: Text Boosts Generalization in Image-Based Person Re-identification

ReText is a method that enhances image-based person re-identification by incorporating textual descriptions into training. The authors augment existing multi-camera datasets with captions generated by a fine‑tuned Vision‑Language Model and train the system on three tasks: Re-ID, image‑text matching, and image reconstruction guided by text. Experiments show that ReText improves generalization across unseen domains and outperforms current state‑of‑the‑art approaches on cross‑domain Re‑ID benchmarks.

By Timur Mamedov, Karina Kvanchiani, Anton Konushin, Vadim Konushin
arXiv Computer Vision
Oct 21

In PRAISE of Attributes: Grounding Retrieval Geometry with Query-Conditioned Subspaces for Person Re-Identification

The paper introduces PRAISE, a test‑time adaptation framework for vision‑language model based person re‑identification. PRAISE constructs an Attribute‑Conditioned Subspace (ACS) from a bank of attribute prompts, reshaping query‑gallery affinities without requiring identity or attribute labels. Experiments on image‑to‑image and text‑to‑image ReID benchmarks show that PRAISE consistently improves retrieval performance over existing backbones and TTA baselines.

By Rajarshi Bhattacharya, Aryan Shukla, Shakeeb Murtaza, Christian Desrosiers, Jose Dolz, Maguelonne Heritier, Eric Granger
arXiv AI
Jun 11

ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation

arXiv:2606. 11670v1 Announce Type: cross Abstract: Subject-preserving video generation is not solved by frontal-face similarity alone: a generated person must remain recognizable across motion, large viewpoint changes, expression shifts, occlusion, scale variation, and conflicts among text, first-frame, and identity references.

By Zijie Meng, Jiwen Liu, Yufei Liu, Chengzhuo Tong, Xiaoqiang Liu, Yuanxing Zhang, Yulong Xu, Pengfei Wan
arXiv Computer Vision
Oct 5

DEPICT: Scoring Text-to-Image Alignment by Answer Agreement

DEPICT is a new training‑free metric for evaluating text‑to‑image alignment. It replaces fixed reference answers with an agreement rule that compares image‑based and caption‑only responses, weighting questions by how decisively the caption determines them. By merging this agreement score with a holistic score, DEPICT improves negation accuracy dramatically and outperforms existing training‑free metrics while matching or exceeding fine‑tuned evaluators on several benchmarks.

By Vasco Ramos, Sandra Godinho Silva, Joao Magalhaes, Ricardo Rei, Pedro Henrique Martins
arXiv AI
Sep 30

One Geometry, Different Outcomes: Readout-Dependent Effects of the Modality Gap in Vision-Language Models

The paper investigates how the modality gap— the separation between image and text representations in contrastive vision‑language models—affects different downstream tasks. By showing that a single dominant direction accounts for most of the image‑text mean separation, the authors explain why reducing or removing this gap can improve zero‑shot classification, degrade retrieval, or restore performance depending on the task. The study provides a geometric framework that clarifies when and why gap interventions should be applied in vision‑language systems.

By Aditya Sharma, Divya Saxena