arXiv Computer Vision
Beyond Visible Speakers: Context-Aware Active Speaker Detection with Speaker Registration
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Sep 23
ROAM-ASD: Robust Open-World Active Speaker Detection with Flexible Multimodal Fusion
arXiv:2609.26648v1 Announce Type: cross Abstract: Active speaker detection (ASD) requires reliable association between visible faces and acoustic speech, yet existing systems often degrade under chal...
arXiv AI
Jun 18
Revisiting Active Speaker Detection: An In-the-Wild Benchmark for Generalization and Robustness
arXiv:2505. 21954v2 Announce Type: replace-cross Abstract: We present UniTalk, a novel dataset emphasizing challenging scenarios to enhance model generalization for the task of active speaker detection (ASD).
arXiv Computation and Language
Sep 28
Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognition
The paper introduces a new target‑speaker unlearning task for automatic speech recognition (TSU‑ASR) that allows certain speakers to opt out of transcription while still indicating their presence. A lightweight Enrollment‑Conditioned Gating (ECG) module is added to a frozen dual‑stream speech LLM, enabling dynamic unlearning of new opt‑out speakers during inference. Experiments on AMI and AliMeeting datasets show significant drops in transcription accuracy for opt‑out speakers while preserving performance for retained speakers.
arXiv Computer Vision
Sep 28
Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction
arXiv:2609.30631v1 Announce Type: cross Abstract: Online audio-visual target-speaker extraction aims to remove competing voices while preserving speech quality and bounding lookahead. Existing extrac...
arXiv Machine Learning
Jul 28
Face Recognition with Machine Learning in OpenCV_ Fusion of the results with the Localization Data of an Acoustic Camera for Speaker Identification
arXiv:1707. 00835v1 Announce Type: cross Abstract: This contribution gives an overview of face recogni-tion algorithms, their implementation and practical uses.
arXiv Computation and Language
Oct 21
How to get the best and fairest performance out of your ASR system using activation steering
The paper explores activation steering as a method to enhance automatic speech recognition (ASR) performance and demographic fairness. It compares two techniques—paired activation subtraction and supervised optimization—finding that supervised optimization effectively improves overall ASR accuracy and fairness across gender, age, and dialect. The study also demonstrates that steering vectors trained on acoustically similar speakers can yield competitive or superior results, enabling few‑shot or zero‑shot adaptation without requiring demographic labels.