arXiv AI By Jayasimha Talur, Oleg Smirnov, Paul Missault

Few-Shot Out of Domain Intent Detection with Covariance Corrected Mahalanobis Distance

Read the original on arXiv AI →

The paper introduces a covariance‑corrected Mahalanobis distance method for detecting out‑of‑domain (OOD) intents in conversational agents. It builds on prior work showing Mahalanobis distance’s effectiveness but addresses its shortcomings in few‑shot scenarios, where limited examples of new intents are available. The authors analyze why the original approach underperforms and propose a refined distance metric to improve OOD detection in practical settings.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jul 31

Selecting Open-Weight Language Models for Zero-Shot Intent Classification: A Systematic Evaluation of 41 Models

arXiv:2607. 27421v1 Announce Type: cross Abstract: Intent classification is a core component of task-oriented dialogue systems, yet practitioners have limited systematic guidance for selecting deployable open-weight language models under compute, latency, and robustness constraints.

By Parishruthi Ganesh, Gerry Dozier, Cheryl Seals
arXiv AI
Aug 24

When Do LLMs Replace Fine-Tuned NLU? A Decision Framework for Intent Detection in Production Conversational Systems

The paper evaluates whether zero‑shot large language models (LLMs) can replace fine‑tuned natural language understanding (NLU) classifiers for intent detection in conversational systems. Experiments on ATIS and CLINC150 show that fine‑tuned RoBERTa outperforms Claude Haiku zero‑shot when ample in‑domain labels are available, but the LLM matches the supervised model on the broader 150‑intent CLINC150 schema. The authors identify three production‑relevant scenarios where LLMs excel—out‑of‑scope detection, robustness to ASR noise, and dynamic per‑deployment schemas—and present a decision framework to guide practitioners. whyItMatters:"The study provides concrete evidence and a practical framework for deciding when to deploy LLMs versus fine‑tuned models in real‑world conversational applications."

By Carson Rodrigues, Oysturn Vas
arXiv AI
Aug 25

Aslema at NADI 2026: Data Augmentation for Intent Recognition and Slot Filling

The paper introduces Aslema, a system for the NADI 2026 Shared Task 5, which includes intent recognition and slot filling. The authors evaluate four omni LLMs in zero‑shot and fine‑tuned settings, finding that fine‑tuning consistently outperforms zero‑shot inference. They further augment data by generating culturally grounded Tunisian Derja utterances with an LLM and synthetic speech via voice cloning, which improves performance; the final system based on Qwen3‑Omni‑30B achieves 86.8% intent accuracy and 34.7 WER on devtest, ranking 1st in slot filling and 4th in intent recognition on the official test set.

By Tajwaar Shafiq, Hunzalah Hassan Bhatti, Firoj Alam, Shammur Absar Chowdhury
arXiv AI
Sep 25

A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations

The paper introduces a pipeline that generates intent‑labeled, two‑channel conversational speech from relational event lists, enabling controlled synthesis of full‑duplex dialogue with 42 phenomena across eight families in English and Mandarin. By having an LLM author each event’s speaker, text, conversational act, and attachment, and then aligning and timing these events independently, the system produces diverse, realistic turn‑taking signals. Experiments show that models trained on this synthetic corpus achieve higher floor‑occupancy accuracy and better start‑speaking/listening F1 scores compared to models trained on prior data.

By Matthew Sun, Vinay Kothapally, Meng Yu, Chao Huang, Hao Zhang, Yixuan Zhang, Steve Yves