arXiv AI

CertBind from Multimodal Connectivity to Certifiable Retrieval Decisions

arXiv:2608. 06516v1 Announce Type: cross Abstract: Lightweight connectors make frozen multimodal encoders composable at the representation level.

arXiv Machine Learning
Aug 21

Beyond Multimodal Alignment: Certifying Physical Language through Response Substitution and Ordered Execution

arXiv:2608. 19492v1 Announce Type: new Abstract: World models increasingly treat compact multimodal representations as interfaces between perception and physical interaction, yet existing probes do not establish whether different sensors carry the same executable meaning or whether that meaning survives a new action composition.

By Kaizhen Tan, Xin Xu, Siru Tao, Yixiao Li, Hanzhe Hong, Yang Feng, Heqing Du
arXiv Computer Vision
Sep 15

Hyper-LLaVA: Hyperbolic Uncertainty-aware Modality-Balanced Routing for Multimodal Continual Instruction Tuning

Hyper-LLaVA introduces a hyperbolic uncertainty‑aware, modality‑balanced routing mechanism for multimodal continual instruction tuning. It improves intra‑modality task matching by evaluating sample‑to‑task distribution similarity in hyperbolic space and mitigates unreliable modality influence by quantifying task‑matching ambiguity to adaptively balance across modalities. The approach achieves significant performance gains over existing methods.

By Kunlun Xu, Yanqin Zhang, Wenwen Qiang, Jiahuan Zhou
arXiv Machine Learning
Sep 25

ICE: Task-Aligned Clifford Latent Fields for Multimodal Graph Foundation Models

ICE (Interaction-aware Clifford Encoder) is a multimodal graph foundation model that uses a node-indexed Clifford latent field to encode topology, text, and images into explicit Cl(3) addresses. Edge-aware geometric products transform these directions into scalar, bivector, and trivector relations over observed neighborhoods, preserving entity semantics while enabling higher-order transport and direct field access. Across eleven graphs and multiple node‑classification, link‑prediction, and few‑shot tasks, ICE outperforms all 30 reported supervised and few‑shot comparisons, with core removals and mechanism controls demonstrating the importance of its higher‑order structure and semantic protection.

By Xunkai Li, Xu Wang, Yinlin Zhu, Xiong Yongfu, Yi Liu, Rong-Hua Li, Guoren Wang
arXiv Computer Vision
Sep 16

Hub-Spectral Activation of Latent Multimodal Knowledge

arXiv:2609.17094v1 Announce Type: new Abstract: Multimodal representation learning seeks shared representations for cross-modal retrieval and knowledge transfer. Hub-based binding reduces pairwise su...

By Ying Guo, Haidong Chen, Linrui Xu, Xiaohao Liu, Chuancheng Shi, Canran Xiao, Dan Zhang, Fei Shen, Li Shen, Tat-Seng Chua
arXiv AI
Sep 30

Can a Cacheable Decision Model Follow Rules?

The paper evaluates Certo, a small non‑generative decision model that scores candidate actions based on text. It compares a joint scorer that processes state, rules, and candidates together with a cacheable encoder that pre‑encodes candidates to reduce cost. Experiments show the cacheable approach loses rule sensitivity, while targeted counterfactual supervision can recover performance on synthetic tasks; however, on real rules the joint scorer still outperforms the cacheable version, and cross‑domain mixtures do not improve accuracy.

By Dushyant Rajput (AltSlate Labs LLP), Nirdesh Chauhan (AltSlate Labs LLP), Siddharth Kosaraju (AltSlate Labs LLP)