Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

26,848 stories · RSS feed

arXiv AI
Oct 5

HazardWeaver: Scientific Route Selection for Hazard Analysis Agents

HazardWeaver is an AI agent designed to select and execute appropriate scientific methods for hazard analysis by leveraging a Hazard Knowledge Compiler and a Hazard Capability Graph. It dynamically revises its route choices as new evidence and execution results emerge, ensuring that selected methods are both applicable and executable with available data and tools. The system is evaluated on the Hazard Weaver Benchmark, which includes 141 instances across multiple hazard domains, and demonstrates superior performance over existing agent systems, especially when multiple scientific routes are viable.

By Wangshu Zhu, Xueqi Cheng, Liang Wu, Yushun Dong
arXiv Machine Learning
Oct 5

Page-EntroKV: Hardware-Aligned, Entropy-Weighted KV-Cache Eviction under Grouped-Query Attention

Page-EntroKV is a new KV‑cache eviction framework designed for grouped‑query attention (GQA) in long‑context autoregressive language models. It pools token importance scores across query heads within each physical group using sink‑isolated Renyi‑2 entropy, then projects these pooled scores onto page frames and performs eviction at the hardware tuple level. The authors prove theoretical guarantees on union overhead, budget preservation, and needle‑retention, and demonstrate on a Qwen2.5‑1.5B‑Instruct pilot that Page‑EntroKV achieves exact union overhead control, eliminates sink masquerade, and retains 100% of critical tokens compared to mean‑pooling baselines.

By Inbasekaran S
arXiv AI
Oct 5

DataWeave: Deploying Human-LLM Analytics for Exploratory Structured Data Analysis

arXiv:2610.02679v1 Announce Type: new Abstract: Data journalism, the practice of using data analysis to surface newsworthy stories, depends increasingly on the ability of reporters and investigative...

By Raquib Bin Yousuf, Harith Laxman, Vitaliy Shkremetko, Eunice Son, Shambhavi Verma, Brian O'Leary, Venketesh Subramony, Sylvain Nazef, Jacquelyn Elias, Ron Coddington, Chris Contakes, Michael Riley, Naren Ramakrishnan