Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

31,091 stories · RSS feed

arXiv AI

Jun 6

ReTreVal: Reasoning Tree with Validation and Cross-Problem Memory for Large Language Models

arXiv:2601. 02880v2 Announce Type: replace Abstract: Every existing inference-time reasoning framework discards all failure context at problem boundaries, leaving a model solving problem 500 no wiser than it was on problem 1.

By Abhishek HS, Pavan C Shekar, Arpit Jain, Ashwanth Krishnan

llms fine-tuning benchmarks

arXiv AI

Jun 6

Reducing Hallucinations in Complex Question Answering using Simple Graph-based Retrieval-Augmented Generation (long version)

arXiv:2606. 05901v1 Announce Type: cross Abstract: Large language models (LLMs) have fundamentally transformed the landscape of Natural Language Processing.

By Christopher J. Wedge, Joshua Stutter, Danny Dixon, Jacek Ca{\l}a

llms rag agents nlp fine-tuning benchmarks safety

arXiv AI

Jun 6

Stability vs. Manipulability: Evaluating Robustness Under Post-Decision Interaction in LLM Judges

arXiv:2606. 05384v1 Announce Type: new Abstract: LLM-as-judge evaluation is widely used in benchmarking pipelines, where model outputs are compared and ranked using automated evaluators.

By Srimonti Dutta, Akshata Kishore Moharir

llms benchmarks

arXiv AI

Jun 6

SoCRATES: Towards Reliable Automated Evaluation of Proactive LLM Mediation across Domains and Socio-cognitive Variations

arXiv:2606. 05563v1 Announce Type: new Abstract: Evaluating LLM mediators remains challenging, as mediation unfolds as a real-time trajectory shaped by disputants' shifting emotions, intentions, and context.

By Taewon Yun, Hyeonseong Park, Jeonghwan Choi, Hayoon Park, Yeeun Choi, Hwanjun Song

llms agents benchmarks safety

arXiv AI

Jun 6

LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video

arXiv:2606. 05677v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have advanced image and video understanding and can increasingly handle longer visual inputs.

By Shiqiang Lang, Jing Liu, Haoyang He, Peiwen Sun, Yuanteng Chen, Tao Liu, Lan Yang, Longteng Guo, Honggang Zhang

llms agents robotics multimodal benchmarks

arXiv AI

Jun 6

The Role of Instructional Guidance in Generative AI-Assisted Learning: Empirical Evidence from Construction Engineering Education

arXiv:2606. 05509v1 Announce Type: cross Abstract: Generative artificial intelligence (AI) is increasingly used to support self-directed learning, yet student interaction with such systems often remains unstructured, limiting engagement in deeper cognitive processes.

By Xiaoyu Hou, Bo Xiao, Hexu Liu, Shane Mueller

llms

arXiv AI

Jun 6

From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment

arXiv:2606. 05180v1 Announce Type: cross Abstract: Automated scoring models are increasingly used to assign rubric-based quality ratings to complex language performances, including classroom transcripts, yet they typically provide little insight into why a particular score is produced.

By Ivo Bueno, Babette B\"uhler, Philipp Stark, Tim F\"utterer, Ulrich Trautwein, Dorottya Demszky, Heather Hill, Enkelejda Kasneci

llms fine-tuning safety

arXiv AI

Jun 6

Synthetic Contrastive Reasoning for Multi-Table Q&A

arXiv:2606. 05382v1 Announce Type: new Abstract: Multi-table question answering requires models to retrieve relevant evidence, link schemas, and perform compositional reasoning across relational tables.

By Ankit Pratap Singh, Xin Su, Phillip Howard

llms nlp fine-tuning

arXiv AI

Jun 6

A Systematic Analysis of Biases in Large Language Models

arXiv:2512. 15792v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have rapidly become indispensable tools for acquiring information and supporting human decision-making.

By Xulang Zhang, Rui Mao, Erik Cambria

llms nlp safety

arXiv AI

Jun 6

MAviS: A Multimodal Conversational Assistant For Avian Species

arXiv:2603. 07294v2 Announce Type: replace-cross Abstract: Fine-grained understanding and species-specific multimodal question answering are vital for advancing biodiversity conservation and ecological monitoring.

By Yevheniia Kryklyvets, Mohammed Irfan Kurpath, Sahal Shaji Mullappilly, Jinxing Zhou, Fahad Shabzan Khan, Rao Anwer, Salman Khan, Hisham Cholakkal

llms nlp multimodal benchmarks

arXiv AI

Jun 6

Noise-Aware Visual Representation Learning for Medical Visual Question Answering

arXiv:2606. 05535v1 Announce Type: cross Abstract: Medical visual question answering (Med-VQA) has strong potential for clinical decision support by enabling AI models to interpret medical images and answer clinically relevant queries.

By I Putu Adi Pratama, Bahadorreza Ofoghi, Atul Sajjanhar, Shang Gao

llms rag nlp fine-tuning benchmarks

arXiv AI

Jun 6

LLM Self-Recognition: Steering and Retrieving Activation Signatures

arXiv:2606. 06315v1 Announce Type: new Abstract: Recent advances in interpretability suggest that large language models (LLMs) implicitly encode signals in their generated text that enable self-recognition of their outputs.

By Thibaud Ardoin, Jonas Sch\"afer, Gerhard Wunder

llms rag safety

arXiv AI

Jun 6

Agentic Molecular Recovery via Molecule-Aware Exploration

arXiv:2606. 05847v1 Announce Type: new Abstract: Text-guided molecular generation with LLMs often yields invalid SMILES.

By Suwan Yoon, Changhee Lee

llms agents

arXiv AI

Jun 6

A Study of LLMs' Preferences for Libraries and Programming Languages

arXiv:2503. 17181v4 Announce Type: replace-cross Abstract: Despite the rapid progress of large language models (LLMs) in code generation, existing evaluations focus on functional correctness or syntactic validity, overlooking how LLMs make critical design choices such as which library or programming language to use.

By Lukas Twist, Mark Harman, Don Syme, Joost Noppen, Helen Yannakoudakis, Detlef Nauck, Jie M. Zhang

llms fine-tuning benchmarks

arXiv AI

Jun 6

Synapse: Federated Tool Routing via Typed Compendium Artifacts

arXiv:2602. 00911v2 Announce Type: replace Abstract: The unit of collaboration in federated learning determines what guarantees are even expressible.

By Abhijit Chakraborty, Yash Shah, Vivek Gupta

llms safety

arXiv AI

Jun 6

TOKI: A Bitemporal Operator Algebra for Contradiction Resolution in LLM-Agent Persistent Memory

arXiv:2606. 06240v1 Announce Type: cross Abstract: Persistent memory for an LLM agent is a write-heavy substrate: every belief update is a versioned write, and a new claim may contradict a stored one.

By Ziming Wang

llms agents

arXiv AI

Jun 6

Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution

arXiv:2606. 06492v1 Announce Type: cross Abstract: Code language models need repository-level context to resolve imports, APIs, and project conventions.

By Liliana Hotsko, Yinxi Li, Yuntian Deng, Pengyu Nie

llms rag fine-tuning benchmarks

arXiv AI

Jun 6

Beyond Code Pairs: Dialogue-Based Data Generation for LLM Code Translation

arXiv:2512. 03086v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have shown remarkable capabilities in code translation, yet their performance deteriorates in low-resource programming domains such as Fortran and emerging frameworks like CUDA, where high-quality parallel data are scarce.

By Le Chen, Nuo Xu, Winson Chen, Bin Lei, Pei-Hung Lin, Dunzhi Zhou, Rajeev Thakur, Caiwen Ding, Ali Jannesari, Chunhua Liao

llms fine-tuning

arXiv AI

Jun 6

IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization

arXiv:2407. 10486v3 Announce Type: replace Abstract: Query-focused summarization (QFS) aims to produce summaries that answer particular questions of interest, enabling greater user control and personalization.

By Jie Cao, Dian Jiao, Yang Dai, Rolan Yan, Wenqiao Zhang, Siliang Tang

llms nlp benchmarks safety

arXiv AI

Jun 6

World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis

arXiv:2606. 05979v1 Announce Type: cross Abstract: We propose world-language-action (WLA) models as a new class of embodied foundation models.

By Yi Yang, Zhihong Liu, Siqi Kou, Yiyang Chen, Yanzhe Hu, Jianbo Zhou, Boyuan Zhao, Zhijie Wei, Xiao Xia, Xueqi Li, Pengfei Liu, Zhijie Deng

llms diffusion robotics multimodal benchmarks

Get the daily briefing