arXiv AI By Muneeb Khan, Frederic Kirstein, Terry Ruas, Bela Gipp

Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting

Read the original on arXiv AI →

The paper introduces CAPA, a Collaborative Agent Predictive Architecture designed to give large language model (LLM) agents situational awareness in online meetings. CAPA uses a Perceiver to update meeting state, a Predictor to forecast conversation flow, a Controller to decide speaking actions, and a Generator to phrase contributions. Evaluated on 137 AMI meetings, CAPA reduces the silence rate from 51.4% to 2.5%, doubles credited recovery, and maintains low hallucination, demonstrating that structured state tracking is key to effective delegation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Sep 3

Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting

The paper introduces CAPA, a Collaborative Agent Predictive Architecture designed to improve large language model (LLM) participation in online meetings. CAPA tracks meeting state with a Perceiver, predicts conversation flow, decides when and what to speak, and generates contributions in the participant’s style, all while being calibrated by judges. In experiments on 137 AMI meetings, CAPA cuts the LLM’s silence rate from 51.4% to 2.5%, doubles credited recovery, and maintains low hallucination.

arXiv AI
2d ago

A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations

The paper introduces a pipeline that generates intent‑labeled, two‑channel conversational speech from relational event lists, enabling controlled synthesis of full‑duplex dialogue with 42 phenomena across eight families in English and Mandarin. By having an LLM author each event’s speaker, text, conversational act, and attachment, and then aligning and timing these events independently, the system produces diverse, realistic turn‑taking signals. Experiments show that models trained on this synthetic corpus achieve higher floor‑occupancy accuracy and better start‑speaking/listening F1 scores compared to models trained on prior data.

By Matthew Sun, Vinay Kothapally, Meng Yu, Chao Huang, Hao Zhang, Yixuan Zhang, Steve Yves
arXiv AI
Aug 24

Consilience: Conformally Calibrated Communication Control for Hidden-Profile Multi-Agent Reasoning

Consilience is an inference‑time orchestration framework that steers and certifies communication among multi‑agent large language models in hidden‑profile settings. It summarizes each discussion turn with a compact state of uncertainty, disagreement, evidence gain, redundancy, and premature consensus, then selects a communication intervention (challenge, clarify, seek evidence, or route) and speaker. A round‑wise conformal calibration procedure guarantees that the controller’s proposed action has bounded one‑step regret with high probability, and an acceptance mechanism enforces this guarantee for the executed action. Experiments on HiddenBench‑style tasks show that Consilience improves decision accuracy and communication efficiency over fixed and unstructured protocols, sometimes outperforming a full‑information baseline.

By Abhijith Babu, Ramneet Kaur, Vishal Pramanik, Olivera Kotevska, Nathaniel D. Bastian, Susmit Jha, Sunny Raj, Yanzhao Wu, Sumit Kumar Jha, Anirban Roy
arXiv AI
Sep 17

When to Call an LLM: A Confidence-Gated Hybrid for Cost-Effective Emotion Recognition in Conversational AI

The paper evaluates three approaches for emotion recognition in conversation— a low‑cost stacked ensemble, an off‑the‑shelf LLM prompt, and a confidence‑gated hybrid that escalates only uncertain ensemble predictions to the LLM. Across three datasets (IEMOCAP, MELD, CMU‑MOSI), the hybrid consistently outperforms each pure system, achieving higher weighted F1 scores while routing most traffic through the inexpensive ensemble. This results in significant cost savings (≈$10‑85 per million utterances) and provides an interpretable escalation signal tied to emotion or sentiment shifts.

By Sai Babu Udayagiri, Arjun Chouhan, Ravisekhar Kanagala, Trishala Pavagada