arXiv Machine Learning June 16, 2026 By Yochai Yemini, Yoav Ellinson, Rami Ben-Ari, Sharon Gannot, Ethan Fetaya

SSNAPS: Audio-Visual Separation of Speech and Background Noise with Diffusion Inverse Sampling

Read the original on arXiv Machine Learning →

arXiv:2602. 01394v2 Announce Type: replace-cross Abstract: This paper addresses the challenge of audio-visual single-microphone speech separation and enhancement in the presence of real-world environmental noise.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 11

DAVE: A Decoupled Audio-Visual Enhancement Framework for Real-World Speech Separation

arXiv:2608. 09288v1 Announce Type: cross Abstract: Audio-visual speech enhancement under real-world conditions remains challenging due to unreliable visual inputs and the lack of large-scale training data with realistic acoustic conditions.

By Wei Zhou, Wanyi Ning, Yinshang Guo, Qianxiao Fang, Haitao Qian, Yingpeng Li

diffusion multimodal

arXiv AI

Jun 24

Audio-visual Contrastive Alignment for Diffusion-based Visual-conditioned Speech Enhancement

arXiv:2606. 23712v1 Announce Type: cross Abstract: Audio-visual speech enhancement (AVSE) exploits visual cues such as lip movements to recover speech in noisy environments.

By Colombe Mboungou (MULTISPEECH), Mostafa Sadeghi (MULTISPEECH), Jean-Eudes Ayilo (MULTISPEECH), Romain Serizel (MULTISPEECH)

diffusion multimodal safety

arXiv Computer Vision

6d ago

Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction

arXiv:2609.30631v1 Announce Type: cross Abstract: Online audio-visual target-speaker extraction aims to remove competing voices while preserving speech quality and bounding lookahead. Existing extrac...

By Rayhan Rashed, Senja Filipi, Ross Cutler

fine-tuning multimodal benchmarks

arXiv Machine Learning

Sep 10

Iterative Audio Separation with Mixture Consistency via MIMO Model Extension

arXiv:2609.07226v1 Announce Type: cross Abstract: This paper proposes a general framework for stable and effective iterative audio separation with mixture consistency by extending source separation m...

By Yukara Ikemiya, WeiHsiang Liao, Yuki Mitsufuji

diffusion benchmarks

arXiv AI

Aug 5

GAP-URGENet: A Generative-Predictive Fusion Framework for Universal Speech Enhancement

arXiv:2604. 01832v1 Announce Type: cross Abstract: We introduce GAP-URGENet, a generative-predictive fusion framework developed for Track 1 of the ICASSP 2026 URGENT Challenge.

By Xiaobin Rong, Yushi Wang, Zheng Wang, Jing Lu

arXiv Computer Vision

Sep 23

ROAM-ASD: Robust Open-World Active Speaker Detection with Flexible Multimodal Fusion

arXiv:2609.26648v1 Announce Type: cross Abstract: Active speaker detection (ASD) requires reliable association between visible faces and acoustic speech, yet existing systems often degrade under chal...

By Pu Wang, Yujun Wang, Hugo Van hamme

multimodal benchmarks

One email a morning, machine-written

Related stories

DAVE: A Decoupled Audio-Visual Enhancement Framework for Real-World Speech Separation

Audio-visual Contrastive Alignment for Diffusion-based Visual-conditioned Speech Enhancement

Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction

Iterative Audio Separation with Mixture Consistency via MIMO Model Extension

GAP-URGENet: A Generative-Predictive Fusion Framework for Universal Speech Enhancement

ROAM-ASD: Robust Open-World Active Speaker Detection with Flexible Multimodal Fusion