The paper presents a method for robust multimodal sentiment analysis that handles incomplete or noisy modalities. It introduces a completeness estimation technique to measure how much sentiment-relevant information remains in partial data, guiding the reconstruction of missing semantics. A joint training strategy stabilizes multi-task learning for sentiment prediction and completeness estimation, and experiments on three benchmark datasets show improved semantic reconstruction and sentiment accuracy.
arXiv:2608. 19971v1 Announce Type: new Abstract: Multimodal sentiment analysis aims to infer affective states by integrating language, visual, and acoustic cues.
arXiv:2608. 20019v1 Announce Type: new Abstract: Incomplete multimodal sentiment analysis has garnered significant attention in recent years.
arXiv:2608. 09986v1 Announce Type: new Abstract: Most existing multimodal sentiment analysis approaches assume access to complete multimodal inputs.
Reliability-aware Cross-sample Enhancement (RCE) is a framework for multimodal sentiment analysis that tackles noise and missing modalities by first applying an adaptive variational information bottleneck to compress unreliable modality information. It then retrieves high‑confidence, semantically consistent neighbors from a large candidate pool to enrich current representations, and finally fuses cross‑modal interactions through a multilevel reliability‑aware mechanism. Experiments show RCE consistently outperforms state‑of‑the‑art methods in full, noisy, and missing‑modality scenarios.
SemMSA introduces a latent semantic‑aided framework for multimodal sentiment analysis that leverages large language models to generate rich sentiment‑relevant semantics. The method employs Cross‑modal Semantic Refinement (CSR) to fuse visual, acoustic, and language features in a frozen LLM embedding space, and Cross‑modal Spectral Alignment (CSA) to align these refined semantics with all modalities via spectral enhancement of kernel Gram matrices. Experiments on SIMS, MOSI, and MOSEI benchmarks show that SemMSA achieves state‑of‑the‑art performance.
arXiv:2610.31731v1 Announce Type: new Abstract: Multimodal sentiment analysis (MSA) aims to predict human sentiments by integrating signals from different modalities such as text, video, and audio. H...
arXiv:2608. 03611v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) integrates text, audio, and vision to infer human affect, yet real-world multimodal observations are often incomplete.
arXiv:2608. 04013v1 Announce Type: cross Abstract: Recent advances in Multimodal Emotion Recognition in Conversations (MERC) highlight its reliance on complete multimodal inputs.
The paper introduces Uncertainty‑Guided Multimodal Consensus (UMC) for multimodal sentiment analysis. UMC first recovers continuous unimodal pseudo‑labels using Continuous Prototype‑Guided Label Recovery (CPLR), which blends heteroscedastic predictions with ordered sentiment prototypes and refines them with confidence and label conflict. It then forms a reliability‑aware consensus across modalities via Reliability and Precision Consensus (RPC), which estimates sample‑dependent modality reliability from predictive statistics and cross‑modal disagreement and combines it with predictive precision through a closed‑form solver. Experiments on four public MSA datasets show that UMC outperforms existing methods.
arXiv:2606. 06285v1 Announce Type: new Abstract: Time series foundation models (TS-FMs) aim to learn generalizable temporal representations that can be adapted to a wide range of downstream tasks.
arXiv:2610.20543v1 Announce Type: new Abstract: Multimodal sentiment models are usually evaluated on complete utterances, yet streams often lose a contiguous span of text, audio, or video. We study l...
I$^2$-KAN is a new multimodal sentiment analysis framework that separates intra‑modal and pairwise inter‑modal information into distinct pathways. Each pathway is refined by a Task‑Decoupled Linear‑Gated Denoising Bottleneck and fused using a structured Kolmogorov‑Arnold Network, enabling explicit pathway associations and multi‑level interpretation. Experiments on CMU‑MOSI, CMU‑MOSEI, and CH‑SIMS v2 show strong performance and reveal that a modality’s standalone predictive power does not always reflect its interaction‑conditioned utility.