Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

31,384 stories · RSS feed

arXiv AI
Sep 21

Visual Navigation Transformer with Pose Attention

arXiv:2609.21212v1 Announce Type: cross Abstract: Learned navigation policies typically consume observations as a temporally ordered history, with positional encodings tying each observation to when...

By Beiming Li, Jaime Romero, Jonathan Diller, Vijay Kumar, Alejandro Ribeiro
arXiv AI
Sep 21

DENSE: Distilling Agent Trajectories into Evidence-Grounded Shortcut Trees for Self-Refinement

arXiv:2609.21423v1 Announce Type: new Abstract: Online agent deployments produce abundant execution traces, while task-specific verification and expert annotation are costly to scale. We study how to...

By Siyuan Liu (Fudan University, Meituan Longcat Team), Fan Yu (Fudan University, Meituan Longcat Team), Dongyu Ru (Meituan Longcat Team), Yizhu Liu (Meituan Longcat Team), Yifan Yang (Meituan Longcat Team), Xuezhi Cao (Meituan Longcat Team), Xunliang Cai (Meituan Longcat Team), Yixin Cao (Fudan University)
arXiv AI
Sep 21

Auditing a KB Elicitation of Frontier LLM Knowledge: A Multi-dimensional Analysis of GPTKB v1.5

The paper presents a framework and results of a multi-dimensional analysis of GPTKB v1.5, a 100‑million‑fact knowledge base elicited from GPT‑4.1. It shows that the LLM’s factual knowledge differs markedly from established knowledge bases and that its accuracy is lower than suggested by prior benchmarks. The study also identifies inconsistency, ambiguity, and hallucinations as major issues, pointing to future research directions in neuro‑symbolic AI for extracting, consolidating, and verifying factual LLM knowledge.

By Shrestha Ghosh, Luca Giordano, Yujia Hu, Tuan-Phong Nguyen, Simon Razniewski
Simon Willison
Sep 20

Quoting voxium

Simon Willison describes his experience at a large company where all documentation, code, tests, PRDs, tickets, and reports are generated by Claude Code. His team is forced to ship rapidly, working long hours, yet management insists that code push is not a bottleneck, leading to frustration and a lack of meaningful reading or review. The situation highlights a reliance on AI-generated content that may undermine quality and collaboration.

Simon Willison
Sep 20

llm-keys-ui 0.1

The release of llm-keys-ui 0.1 introduces a plugin that allows users to manage API keys on remote machines without pasting them into the ChatGPT app. By running a simple command, the plugin provides a local or Tailscale URL for an interface where additional keys can be saved, and later retrieved via a shell command. This streamlines key management for coding agents used in LLM projects.