Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

30,036 stories · RSS feed

arXiv AI

Jun 10

READER: Robust Evidence-based Authorship Decoding via Extracted Representations

arXiv:2606. 10794v1 Announce Type: new Abstract: As agentic applications increasingly route user tasks through official and third-party LLM APIs, provenance becomes an operational question: which model generated a given black-box response?

By Jiaxu Liu, Sunnan Mu, Dong Huang, Liuyin Wang, Jing Shao, Jie Zhang

llms agents benchmarks

arXiv Machine Learning

Jun 10

N-GRPO: Embedding-Level Neighbor Mixing for Enhanced Policy Optimization

arXiv:2606. 10768v1 Announce Type: new Abstract: The success of Large Language Models in mathematical reasoning relies heavily on the generation of diverse and valid solution paths during the rollout phase.

By Xukun Zhu, Hang Yu, Peng Di, Linchao Zhu

llms rag benchmarks

arXiv AI

Jun 10

CLP: Collocation-Length Prediction for Zero-Loss Adaptive Multi-Token Inference

arXiv:2606. 10935v1 Announce Type: cross Abstract: Large language model inference is bottlenecked by autoregressive decoding, where each token requires a full forward pass.

By Xuezhen Xie, Zhiqiang Zhou

llms

arXiv AI

Jun 10

From Perception to Action: Can UI Interventions Foster Sustainable LLM Chatbot

arXiv:2606. 10861v1 Announce Type: cross Abstract: LLM-powered chatbots are increasingly embedded in everyday workflows, raising sustainability concerns due to their energy use.

By Nitish Patkar, Pooja Rani, Jack Gl\"asser, Simon L\"uscher, Martin Kropp

llms

arXiv AI

Jun 10

Advancing the State-of-the-Art in Empirical Privacy Auditing

arXiv:2606. 10481v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning of large language models (LLMs) can exhibit problematic memorization of individual training examples.

By Nicole Mitchell, Galen Andrew, Arun Ganesh, Brendan McMahan, Peter Kairouz

llms fine-tuning benchmarks safety

arXiv AI

Jun 10

ERAlign: Energy-based Representation Alignment of GNNs and LLMs on Text-attributed Graphs

arXiv:2606. 10461v1 Announce Type: cross Abstract: Text-attributed Graphs (TAGs) incorporate textual node attributes with graph structures to describe rich relational semantics.

By Xianlin Zeng, Fan Xia, Xiangyu Chen

llms rag diffusion benchmarks safety

arXiv AI

Jun 10

Moonshine: An Autonomous Mathematical Research Agent Centered on Conjecture Generation

arXiv:2606. 10806v1 Announce Type: new Abstract: Moonshine is an autonomous agent whose central objective is to generate mathematical conjectures.

By Xiaoyang Chen, Xiang Jiang

llms agents

arXiv AI

Jun 10

GCA Framework: A GCC Countries-Grounded Dataset and Agentic Pipeline for Climate Decision Support

arXiv:2604. 12306v3 Announce Type: replace-cross Abstract: Climate decision-making in the GCC states increasingly demands systems that can translate heterogeneous scientific and policy evidence into actionable guidance, yet general-purpose large language models (LLMs) remain weak both in region-specific climate knowledge and grounded interaction with geospatial and forecasting tools.

By Muhammad Umer Sheikh, Khawar Shehzad, Salman Khan, Fahad Shahbaz Khan, Muhammad Haris Khan

llms agents fine-tuning multimodal benchmarks

arXiv AI

Jun 10

When Attribution Patching Lies: Diagnosis and a Second-Order Correction

arXiv:2606. 09899v1 Announce Type: cross Abstract: A central goal of mechanistic interpretability is to identify which internal components causally drive a language model's behavior.

By Luyang Zhang, Jialu Wang

llms benchmarks safety

arXiv AI

Jun 10

TD-Grokking: Learning from Zero-Reward Problems by Training-Time Decomposition

arXiv:2606. 09883v1 Announce Type: cross Abstract: Large language models (LLMs) have made remarkable progress in reasoning tasks, largely driven by post-training paradigms, especially reinforcement learning with verifiable rewards (RLVR).

By Ningyuan Xi, Hao Xu, Hongsheng Xin, Ning Miao

llms reinforcement-learning

arXiv AI

Jun 10

Neurosymbolic Learning for Inference-Time Argumentation

arXiv:2605. 20098v2 Announce Type: replace Abstract: Claim verification is an important problem in high-stakes settings, including health and finance.

By Gabriel Freedman, Adam Dejl, Adam Gould, Mansi, Lihu Chen, Junqi Jiang, Francesca Toni

llms

arXiv AI

Jun 10

Unifying Local Communications and Local Updates for LLM Pretraining

arXiv:2606. 11081v1 Announce Type: cross Abstract: Communication-efficient pre-training of LLMs is increasingly important as training draws on compute distributed across clusters, data centers, and lower-bandwidth links.

By Pietro Cagnasso, Eugene Belilovsky, Edouard Oyallon

llms benchmarks

arXiv AI

Jun 10

Generative Explainability for Next-Generation Networks: LLM-Augmented XAI with Mutual Feature Interactions

arXiv:2606. 10942v1 Announce Type: cross Abstract: As artificial intelligence and machine learning (AI/ML) models become integral to network operations, their lack of transparency poses a significant barrier to operator trust.

By Kiarash Rezaei, Omran Ayoub, Sebastian Troia, Francesco Lelli, Paolo Monti, Carlos Natalino

llms benchmarks

arXiv AI

Jun 10

HIPIF: Hierarchical Planning and Information Folding for Long-Horizon LLM Agent Learning

arXiv:2606. 10507v1 Announce Type: new Abstract: While Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents across a wide range of tasks, their performance often degrades in multi-turn long-horizon agentic tasks.

By Juncheng Diao, Zhicong Lu, Peiguang Li, Yongwei Zhou, Changyuan Tian, Qingbin Li, Rongxiang Weng, Jingang Wang, Xunliang Cai

llms agents nlp reinforcement-learning benchmarks

arXiv AI

Jun 10

ActiveMem: Distributed Active Memory for Long-Horizon LLM Reasoning

arXiv:2606. 10532v1 Announce Type: new Abstract: Memory is essential for enabling large language model (LLM) agents to handle long-horizon reasoning tasks.

By Yunhan Jiang, Wenbin Duan, Shasha Guo, Liang Pang, Xiaoqian Sun, Huawei Shen

llms agents efficiency benchmarks

arXiv AI

Jun 10

When RL Fails after SFT: Rejuvenating Model Plasticity for Robust SFT-to-RL Handoff

arXiv:2606. 09932v1 Announce Type: cross Abstract: Supervised Fine-Tuning (SFT) followed by Reinforcement Learning (RL) has become a standard pipeline for Large Language Model (LLM) post-training.

By Runze Liu, Jiashun Liu, Xu Wan, Yuqian Fu, Ling Pan

llms agents reinforcement-learning fine-tuning

arXiv AI

Jun 10

Causal Ensemble Agent: Hierarchical Causal Discovery with LLM-guided Expert Reweighting

arXiv:2606. 10607v1 Announce Type: cross Abstract: Causal discovery aims to uncover causal structures from observational data, which is crucial for real-world decision-making.

By Xinyu Li, Yuanyuan Wang, Haoxuan Li, Chuan Zhou, Erdun Gao, Bo Han, Tongliang Liu, Kun Zhang, Howard Bondell, Mingming Gong

llms agents safety

arXiv Machine Learning

Jun 10

Dexterous Point Policy: Learning Point-based Dexterous Hand Policies from Human Demonstrations

arXiv:2606. 10614v1 Announce Type: cross Abstract: Robotic foundation models pre-trained on human demonstration videos have shown promise, but a significant embodiment gap remains when the resulting policies are deployed on real robots.

By Beomjun Kim, Seong Hyeon Park, Seunghoon Sim, Seungjun Moon, Sanghyeok Lee, Jinwoo Shin

llms agents robotics fine-tuning benchmarks

arXiv Machine Learning

Jun 10

Multi-task LLMs for Bug Classification: Efficient Inference with Auxiliary Decoding Heads

arXiv:2606. 09956v1 Announce Type: cross Abstract: The rapid adoption of LLM-powered code generation has dramatically accelerated software development, yet effective verification methods remain severely underdeveloped.

By Nikolai Rozanov

llms agents nlp efficiency benchmarks safety

arXiv Machine Learning

Jun 10

The Order Matters: Sequential Fine-Tuning of LLaMA for Coherent Automated Essay Scoring

arXiv:2606. 10327v1 Announce Type: cross Abstract: Automated Essay Scoring (AES) systems must judge interdependent discourse elements (e.

By Ali Keramati, Mark Warschauer

llms nlp fine-tuning efficiency

Get the daily briefing