ReText is a method that enhances image-based person re-identification by incorporating textual descriptions into training. The authors augment existing multi-camera datasets with captions generated by a fine‑tuned Vision‑Language Model and train the system on three tasks: Re-ID, image‑text matching, and image reconstruction guided by text. Experiments show that ReText improves generalization across unseen domains and outperforms current state‑of‑the‑art approaches on cross‑domain Re‑ID benchmarks.
arXiv:2606. 02242v1 Announce Type: cross Abstract: The joint optimization of image-based (I2I) and text-based (T2I) person re-identification (ReID) is hindered by modality discrepancies and conflicting training objectives, leading to suboptimal shared representations.
arXiv:2609.12965v1 Announce Type: new Abstract: Text-based person search (TBPS) aims to retrieve images of a target person from a large image gallery based on a given natural language description. Mo...
The joint optimization of image-based (I2I) and text-based (T2I) person re-identification (ReID) is hindered by modality discrepancies and conflicting training objectives, leading to suboptimal shared representations. While I2I ReID focuses on identity-level invariance across images of the same person, T2I ReID is driven by instance-specific textual descriptions tied to unique visual traits.
arXiv:2606. 09362v1 Announce Type: cross Abstract: Re-Identification (ReID) in autonomous driving is typically formulated as a visual matching problem, where observations of vehicles, pedestrians, and cyclists are associated across time, frames, or camera views using learned appearance embeddings, often complemented by motion, geometric, or multimodal cues.
Flow-CLIP introduces a method to improve compositional image-text matching by refining global image-text alignment with image-conditioned changes in token–patch evidence. It combines Global Compatibility Calibration (GCC) for sentence-level similarity, Image-Conditioned Evidence Refinement (ICER) to incorporate visual patch context, and Cross-Image Margin Ranking (CIMR) to enhance ranking margins when images support correct descriptions. Experiments demonstrate that Flow-CLIP outperforms pretrained CLIP and other global alignment approaches on binding accuracy and reduces reliance on language priors.
arXiv:2609.14419v1 Announce Type: cross Abstract: Person re-identification (ReID) is essential for multi-camera surveillance and tracking, yet remains difficult due to viewpoint and illumination chan...
arXiv:2610.10163v1 Announce Type: new Abstract: Linking people's appearance and actions to character identities is essential for understanding video narratives. We present a framework for identity-aw...
arXiv:2606. 07451v1 Announce Type: cross Abstract: Vision-language models such as CLIP are highly useful for diverse tasks due to their shared image-text embedding space.
ProCAP introduces a probabilistic cross-attentive prompt learning framework for vision-language models like CLIP, enabling improved cross-modal interaction without updating the backbone. It jointly learns visual and textual prompt tokens, linking them via stacked bidirectional multi-head cross-attention to refine each branch across prompt depth. The method incorporates Gaussian parameterization of prompt tokens, lightweight KL and L2 regularization, and a compact symmetric InfoNCE head to align image features with class-level text representations, achieving strong few-shot base-to-novel performance and competitive transfer results across multiple datasets and benchmarks.
arXiv:2607. 00684v1 Announce Type: new Abstract: The classification accuracy of pretrained Vision-Language Models (VLMs) relies on the quality of the text prompts.
The paper introduces Grounded Human-Attributed Description and Activity Recognition (GHADAR), a task that requires describing the characteristics and activities of every person in a video given their locations. It presents a new dataset derived from AVA-Actions with open‑set captions, a method that constrains cross‑attention masks in vision‑language models to better use grounding information, and a holistic VLM‑based evaluation schema that compares concepts directly between video and predictions. Experiments show the proposed method surpasses state‑of‑the‑art VLMs and highlight limitations of existing evaluation metrics.
arXiv:2607. 07179v1 Announce Type: cross Abstract: Document Visual Question Answering (DocVQA) presents a complex multimodal challenge, requiring models to exploit visual, textual, and layout information from documents.