arXiv Machine Learning
MoTE: Mixture of Task Experts for Multi-Task Video Understanding
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Computer Vision
Oct 1
DecoMoE: Decoupling Visual Propagation and Expert Computation for Efficient Multimodal MoE Inference
arXiv:2609.38823v1 Announce Type: new Abstract: Multimodal mixture-of-experts (MoE) models combine sparse expert activation with visual-language capabilities, yet their inference remains costly becau...
arXiv AI
Sep 30
Breaking the Uniformity Trap: Scaling Video Diffusion Model via SplitMoE
arXiv:2609.38140v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE), popularized by large language models, is a promising paradigm for scaling visual generative models. However, conventional t...
Hugging Face Trending Papers
Sep 2
TAME: Temporal-Aware Mixture-of-Experts for Text-Video Retrieval
TAME introduces a Temporal-Aware Mixture-of-Experts framework for Text-Video Retrieval that enhances CLIP-based models by incorporating frame-level structure and temporal relations. It adds sparse Mixture-of-Experts layers with frame-consistent routing, Frame-Temporal tokens for global cross-frame aggregation, and a Cross-Temporal Interaction and Aggregation module to refine sentence-video similarities. Experiments on multiple TVR benchmarks show consistent performance gains, such as a 4.0 R@1 improvement on MSR‑VTT over CLIP4Clip.
arXiv Computer Vision
Aug 31
Task-State Adaptation with Prototype Memory for Multi-Task Dense Prediction
The paper introduces MemMTL, a multi‑task dense prediction framework that uses a compact task state derived from global visual context and refines it via a learnable prototype memory. This refined state informs task‑conditioned expert logits, which are combined with token‑level logits and routed through a sparse top‑k selection over a shared local expert bank. A task‑agnostic residual bank offers a common adaptation path, and both paths are added to the backbone feature before task‑specific prediction. The authors outline an evaluation protocol on NYUD‑v2 and PASCAL‑Context using SAM 3 and ViT‑L backbones to assess predictive quality, computational cost, and the contributions of task‑state conditioning, prototype retrieval, and sparse routing.
arXiv Computer Vision
Sep 3
TAME: Temporal-Aware Mixture-of-Experts for Text-Video Retrieval
TAME is a CLIP‑based framework for Text‑Video Retrieval that incorporates temporal modeling through three key innovations: sparse Mixture‑of‑Experts layers with frame‑consistent routing, Frame‑Temporal tokens that aggregate cross‑frame information, and a Cross‑Temporal Interaction and Aggregation module for refining frame‑wise similarities. These components enable the model to capture both local visual patterns and long‑range temporal dependencies, leading to consistent performance gains over CLIP‑based baselines on multiple TVR benchmarks, including a 4.0 R@1 improvement on MSR‑VTT. The code is publicly available on GitHub.
arXiv Machine Learning
Jun 17
MoSE: Mixture of Slimmable Experts for Efficient and Adaptive Language Models
arXiv:2602. 06154v2 Announce Type: replace Abstract: Mixture-of-Experts (MoE) models scale large language models efficiently by sparsely activating experts, but once an expert is selected, it is executed fully.