← Back to all news
arXiv Machine Learning By Jingqi Sun, Haozhan Tang, Shulin He, Zhong-Qiu Wang

VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation

Read the original on arXiv Machine Learning →

VM-ARRAYDPS introduces virtual microphones with higher signal‑to‑noise ratios to augment a limited physical microphone array, providing additional multi‑channel consistency constraints for blind speech separation. By leveraging a pretrained speech diffusion model and posterior sampling, the method improves upon the existing ArrayDPS approach. Experiments on 2‑speaker and 3‑speaker datasets show significant performance gains, and ablation studies reveal the impact of virtual microphone count and consistency weighting.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv AI
5d ago

CF-AVSS: A Coarse-to-Fine Audio-Visual Speech Separation Framework with Target-Speaker Refinement and Post-Fusion for Real-World AVSE Challenge

The paper introduces CF-AVSS, a two‑stage audio‑visual speech separation framework that first generates coarse estimates using a synchronized visual‑stream SPAV‑TFGridNet, then refines these estimates with a TFGridNet‑based target‑speaker refinement network. The final output is a fusion of coarse and refined estimates calibrated on a development set. In the ISCSLP 2026 Real‑World AVSE Challenge, the system tied for first place on Track 1 and ranked second on Track 2, achieving the lowest character error rates of 12.31 % and 14.79 % respectively.

By Longjie Luo, Zhongshu Hou, Yuepeng Li, Gang Yang, Shidong Shang, Fan Zhou
multimodal
More like this →