← Back to all news
arXiv Computation and Language By Ahmet Tu\u{g}rul Bayrak, Fatma Nur Korkmaz, Nur Ya\u{g}mur Tuncer, Mustafa Serta\c{c} T\"urkel

TurnTurk-GPT: Text-Based Turn-Taking Prediction for Turkish

Read the original on arXiv Computation and Language →

TurnTurk‑GPT is a Turkish text‑based turn‑taking predictor created by fine‑tuning a Turkish GPT‑2 model with the TurnGPT objective on both synthetic and real dialogue. The model is evaluated on real Turkish conversations using word‑level decision points on unpunctuated, lower‑cased text, and it outperforms a multilingual end‑of‑turn detector in both recording‑disjoint and speaker‑disjoint settings. While it matches a zero‑shot Turkish language model on unseen speakers, it only surpasses it when test speakers appear in training; removing verb‑final suffixes significantly degrades performance, highlighting the importance of Turkish morphology for turn detection.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Related stories

arXiv AI
6d ago

The Importance of Speech Genre for End-of-Turn Detector Training

The study investigates how the speech genre of training data affects end‑of‑turn (EoT) detection. By training a streaming ConvLSTM EoT detector on matched corpora—multi‑turn human‑human conversations versus single‑turn human‑machine interactions—the conversational model achieves up to +0.45 higher F1 scores across four test sets, mainly due to fewer false alarms on mid‑turn pauses and hesitations. The advantage persists at both frame‑level and utterance‑level decoding and is evident only when evaluated on conversational data, not on single‑turn speech.

By Rini Sharon, Kadri Hacioglu, Jeena Prakash, Andreas Stolcke
More like this →
arXiv Computation and Language
Aug 27

TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue

TurnBench is a new multi‑domain benchmark for evaluating turn‑taking dynamics in spoken dialogue. It comprises a 30‑hour hand‑labeled corpus of dyadic human conversations, a standardized evaluation protocol for end‑of‑turn and interruption detection, and covers six distinct interaction styles with triple annotation. The benchmark also provides a 104‑hour training set, a public leaderboard, and an interactive dataset viewer at https://turnbench.sesame.com.

By Freeman Jiang, Ramon Sanabria, Soham Deshmukh, Bandhav Veluri, Simon Michael Vuch Williams, Elliott K. Suen, Garreth Lee, Kevin Yoonho Choi, Takuya Umeki, Riku Kubo, Sathvik Udupa, Chien-yu Huang, Shih-Yun Shan Kuan, Zhuoyan Tao, Satyapriya Krishna, Sefik Emre Eskimez, Yu Tsao, Hung-yi Lee, Shinji Watanabe
benchmarks
More like this →
arXiv AI
Sep 12

Less can be More: What Aspects of Speech Drive End-of-Turn Detection

The study investigates which speech aspects best signal the end of a speaker’s turn in conversational AI. By systematically ablating acoustic, prosodic, and semantic cues in a lightweight trimodal classifier, the authors find that combining acoustic and prosodic features yields the highest accuracy and lowest latency, achieving an utterance F1 of 0.93 with 7.8% false alarms at 400 ms median latency. Adding textual information actually increases premature detections without improving performance, and feature analysis shows prosodic cues provide the strongest class separability while text representations overlap significantly.

By Rini Sharon, Manickavela A, Kadri Hacioglu, Andreas Stolcke
benchmarks
More like this →