arXiv Machine Learning

Robust Multimodal Sentiment Analysis with Incomplete Modalities via Semantic-aware Completeness based Reconstruction

The paper presents a method for robust multimodal sentiment analysis that handles incomplete or noisy modalities. It introduces a completeness estimation technique to measure how much sentiment-relevant information remains in partial data, guiding the reconstruction of missing semantics. A joint training strategy stabilizes multi-task learning for sentiment prediction and completeness estimation, and experiments on three benchmark datasets show improved semantic reconstruction and sentiment accuracy.

arXiv Computation and Language
Aug 27

KESA: A Knowledge Enhanced Approach For Sentiment Analysis

The paper introduces KESA, a knowledge‑enhanced approach for sentence‑level sentiment analysis that incorporates sentiment knowledge through two auxiliary tasks: sentiment word cloze and conditional sentiment prediction. These tasks use prior sentiment polarity to guide the selection of sentiment words and the prediction of overall sentiment, respectively, and explore label combination methods to unify multiple label types. Experiments show that KESA consistently outperforms pre‑trained models and complements existing knowledge‑enhanced post‑training methods.

By Qinghua Zhao, Shuai Ma, Shuo Ren