arXiv:2608. 03475v1 Announce Type: cross Abstract: Multimodal intent recognition combines linguistic, acoustic, and visual evidence, but individual modalities may be noisy, missing, semantically conflicting, or disproportionately dominant.
By Suraj Kumar, Mohnish Raj, Soumi Chattopadhayay, Chandranath Adak, Ayan Dutta
arXiv:2507.08375v2 Announce Type: replace
Abstract: Video restoration and enhancement are critical not only for improving visual quality, but also as essential pre-processing steps to boost the perfo...
By Alexandra Malyugina, Yini Li, Joanne Lin, Nantheera Anantrasirichai
The paper introduces MuViS-C, a multi‑domain benchmark that evaluates the robustness of learning‑based virtual sensing models against ten common sensor failure modes, ranging from subtle drifts to catastrophic dropouts. It assesses models using average error, relative degradation, and worst‑case fragility across nine datasets from six domains, comparing six architectures (gradient‑boosted trees, convolution, recurrence, attention, and MLP‑mixing). The study finds that all models degrade under corruption, gradient‑boosted trees are most robust, and targeted robustification can improve attention models at the cost of nominal performance.
By Jens U. Brandt, Noah C. Puetz, Alexander Windmann, Marc Hilbert, Elena Raponi, Thomas B\"ack, Thomas Bartz-Beielstein
Loop‑Mamba is a lightweight, loop‑based state‑space framework designed for restoring old photographs that suffer from multiple degradations such as scratches, cracks, fading, blur, noise, and missing regions. It models restoration as progressive state evolution, using a Semantic‑Guided Degradation Estimator to predict local degradation maps and global scores, and a Shared Structural Memory Mamba to maintain a persistent restoration state across iterations. The method employs first‑order state recursion and a multi‑directional scanning strategy to reduce gradient dilution and computational overhead, and introduces the Old Photo Damage Recovery Score (ODRS) to evaluate both degradation recovery and structural reconstruction, achieving superior performance on the SynOld benchmark.
By Runci Bai, Yucheng Xin, Pu Wang, Yongcong Wang, Chen Wu, Dianjie Lu, Guijuan Zhang, Pengwen Dai, Guangwei Gao, Siyuan Yao, Zhuoran Zheng
Multimodal learning robust to missing modalities is essential for real-world applications. Existing methods mainly focus on inter-modality missing, where entire modalities are absent, while overlooking intra-modality degradation, where modalities are present but severely corrupted.
Virtual sensing, the estimation of hard-to-measure quantities from available sensor measurements, is a critical enabler for control and monitoring in cyber-physical systems. However, when sensors fail...