Hugging Face Trending Papers
Jul 16
Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality
Cross-modal learning, i. e.
Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality
arXiv:2607. 14721v1 Announce Type: cross Abstract: Cross-modal learning, i.
Related stories
arXiv Machine Learning
Jul 13
Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing
arXiv:2607. 08839v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are typically designed under the assumption that all modalities available during training will also be accessible at inference.
arXiv Machine Learning
Jul 2
Multiplicity is an Inevitable and Inherent Challenge in Multimodal Learning
arXiv:2505. 19614v2 Announce Type: replace Abstract: Multimodal learning has seen remarkable progress, particularly with large-scale pre-training across various modalities.
arXiv AI
Jul 7
K9-Bench: Evaluating Multimodal LLMs on Canine-Centric Videos
arXiv:2607. 02680v1 Announce Type: cross Abstract: MLLMs have shown strong zero-shot capabilities across diverse inputs such as across images, video, audio, and text.
arXiv Machine Learning
Jul 7
Beyond Modality Fusion: Deep Ensembles for Multimodal Classification
arXiv:2607. 05019v1 Announce Type: new Abstract: In multimodal classification, late-fusion approaches classify concatenated modality-specific features extracted by unimodal neural networks.
arXiv AI
Jun 17
Mordal: Automated Pretrained Model Selection for Vision Language Models
arXiv:2502. 00241v2 Announce Type: replace-cross Abstract: Incorporating multiple modalities into large language models (LLMs) is a powerful way to enhance their understanding of non-textual data, enabling them to perform multimodal tasks.
arXiv AI
Jun 11
Information-Theoretic Decomposition for Multimodal Interaction Learning
arXiv:2606. 11614v1 Announce Type: cross Abstract: Multimodal learning hinges on capturing redundant, unique, and synergistic information across modalities, which collectively constitute multimodal interactions.
arXiv AI
Jul 8
MLLM-LLaVA-FL: Multimodal Large Language Model Assisted Federated Learning
arXiv:2409. 06067v3 Announce Type: replace Abstract: Previous studies on federated learning (FL) often encounter performance degradation due to data heterogeneity among different clients.
arXiv Machine Learning
Aug 6
Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes
arXiv:2608. 05000v1 Announce Type: cross Abstract: Vision offers a critical axis for advancing foundation models, driving a shift towards natively unified multimodal pretraining.
arXiv Machine Learning
Aug 4
DataClaw0: Agentic Tailoring Multimodal Data from Raw Streams
arXiv:2606. 21337v2 Announce Type: replace Abstract: Raw multimodal streams are abundant but noisy, redundant, and unaligned with any particular training objective.
arXiv Machine Learning
Jul 28
Self-Distillation of Hidden Layers for Self-Supervised Representation Learning
arXiv:2603. 15553v2 Announce Type: replace-cross Abstract: The landscape of self-supervised learning (SSL) is currently dominated by generative approaches (e.
arXiv AI
Jun 12
DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems
arXiv:2601. 13591v2 Announce Type: replace Abstract: Recent LLM-based data agents aim to automate data science tasks ranging from data analysis to deep learning.