arXiv Computer Vision
SenseAlign: Understanding Vision and Touch through Language at Test Time
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computation and Language
Sep 15
Language-Guided Representation Learning for Robust Cross-Sensor Material Recognition
arXiv:2609.14783v1 Announce Type: cross Abstract: Robots need touch to manipulate objects safely and reliably, as many properties, such as softness, texture, and contact stability, are hard to infer...
arXiv AI
Jul 1
RCT: A Robot-Collected Touch-Vision-Language Dataset for Tactile Generalization
arXiv:2606. 31694v1 Announce Type: cross Abstract: For robots manipulating open-world objects, tactile representations must generalize to unseen materials.
arXiv Machine Learning
Aug 6
Tactus: Open-Vocabulary Object Recognition from Low-Cost Pressure Arrays
arXiv:2608. 04043v1 Announce Type: new Abstract: Resistive pressure arrays are the cheapest and most widely shipped tactile sensors, yet tactile representation learning has concentrated on optical sensors that image a deforming gel.
arXiv Computer Vision
Sep 3
Test-Time Logit Prompting for Source-Free Missing Modality Adaptation
The paper introduces Test-Time Logit Prompting (TLP), a lightweight framework that adapts vision-language models to missing-modality inputs without accessing source training data. TLP optimizes logit prompts using uncertainty-aware adjustments and modality-complete consistency regularization, thereby maintaining prediction confidence and semantic consistency. Experiments on various benchmarks show that TLP improves recognition performance by up to 8% while requiring only a few hundred tunable parameters and minimal test-time optimization steps.
arXiv AI
Sep 24
BIDETA: Brain-Inspired Data-Efficient Tactile Adaptation for Unseen Sensors
BIDETA is a gradient‑free framework that adapts pretrained tactile models to new sensors using only a few labeled target contacts. It preserves pretrained representations while repairing sensor‑dependent feature neighborhoods through rapid support memory, support‑conditioned spectral graphs, and reliability‑gated recurrence. Experiments on multiple datasets show that BIDETA dramatically improves accuracy and speeds up adaptation compared to prior methods.
arXiv AI
Jun 8
SS-TPT: Stability and Suitability-Guided Test-Time Prompt Tuning for Adversarially Robust Vision-Language Models
arXiv:2606. 06943v1 Announce Type: cross Abstract: Vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition but remain highly fragile under adversarial perturbations.