Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

32,584 stories · RSS feed

arXiv Computation and Language
Sep 16

Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization

The paper introduces JudgeBiasBench, a benchmark that systematically quantifies judgment biases in large language model (LLM)-based judges across four dimensions and 12 bias types. It evaluates both generative and discriminative judges, revealing significant bias patterns that undermine reliability. The authors propose bias-aware training—reinforcement learning for generative judges and contrastive learning for discriminative judges—to reduce these biases while maintaining evaluation performance.

By Hongli Zhou, Hui Huang, Rui Zhang, Kehai Chen, Bing Xu, Conghui Zhu, Tiejun Zhao, Muyun Yang
Simon Willison
Sep 15

Gemini Live audio

Google has launched Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking, two speech‑to‑speech models similar to OpenAI’s GPT‑Live family. A web UI built with GPT‑6 Astra Extra High lets users select a model, choose a voice preset, provide an optional system prompt, and engage in voice conversations directly in the browser, even interrupting the model while it speaks. The implementation relies on a WebSocket endpoint and the Web Audio API for capturing and playing audio, with no external libraries required.