CF-AVSS: A Coarse-to-Fine Audio-Visual Speech Separation Framework with Target-Speaker Refinement and Post-Fusion for Real-World AVSE Challenge

The paper introduces CF-AVSS, a two‑stage audio‑visual speech separation framework that first generates coarse estimates using a synchronized visual‑stream SPAV‑TFGridNet, then refines these estimates with a TFGridNet‑based target‑speaker refinement network. The final output is a fusion of coarse and refined estimates calibrated on a development set. In the ISCSLP 2026 Real‑World AVSE Challenge, the system tied for first place on Track 1 and ranked second on Track 2, achieving the lowest character error rates of 12.31 % and 14.79 % respectively.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• multimodal