arXiv AI
Modality-Guided Mixture of Structured Experts with Entropy-Triggered Routing for Multimodal Recommendation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Aug 17
MedMix: Specialization-Consistent Federated Sparse MoEs under Modality Heterogeneity
arXiv:2608. 13911v1 Announce Type: new Abstract: Federated multimodal medical AI faces modality heterogeneity at both the client and sample levels: clients may systematically lack access to specific modality types, while individual records within the same client may contain different partial modality subsets.
arXiv AI
Sep 3
Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation
The paper introduces OrthoRec, a multimodal recommender system that challenges the common "modality harmony" assumption by addressing conflicts between multimodal features and collaborative patterns. It employs Collaborative‑Guided Orthogonal Purification (CGOP) to separate useful multimodal signals from noisy orthogonal components, and a Topology‑Aware Routing Mixture‑of‑Experts (TAR‑MoE) to adaptively integrate purified modalities based on collaborative topology. Experiments on Amazon datasets demonstrate that OrthoRec outperforms recent baselines and remains robust to modality noise and item sparsity.
arXiv Machine Learning
Aug 3
GALA: Generative Aligned Learning for Adaptive Multimodal Representation in the Taobao Shangou Recommender System
arXiv:2607. 29213v1 Announce Type: cross Abstract: Modern recommender systems in food delivery increasingly leverage multimodal signals, including images, text, and user interaction histories, to enhance user experience, yet effective fusion of these heterogeneous modalities remains challenging, hindering both the joint modeling of multimodal signals and adaptation to evolving user intent.
arXiv AI
Jun 30
ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation
arXiv:2606. 28357v1 Announce Type: cross Abstract: Recent advances in multimodal recommenders excel at feature fusion but remain opaque and inefficient decision-makers, lacking explicit reasoning and self-awareness of uncertainty.
arXiv Machine Learning
Sep 21
IntBMoE: Integrating Block-Level Conditioning into Expert Composition for Full-Participation Mixture-of-Experts
IntBMoE introduces a block‑conditioned mixture‑of‑experts that decouples participation, execution, and materialization by combining dense expert composition with sparse block execution. Each internal layer uses a lightweight hypernetwork to merge all expert bases into a single composed expert, while a router selects only a few blocks per token, keeping compute and memory costs low. Experiments on image classification, language modeling, and sequential recommendation demonstrate consistent performance gains, and the model is deployed in AMap’s generative recommendation system, improving UVCTR by 2.4% in online A/B tests.
arXiv Machine Learning
Jul 31
Beyond Geometric Complementarity: Coherent Overlap in Sparse Mixture-of-Experts Routing
arXiv:2607. 28308v1 Announce Type: new Abstract: Sparse mixture-of-experts (MoE) language models route each token to multiple experts, suggesting a geometric account of their benefit: co-selected experts should contribute distinct representation directions.