Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

17,376 stories · RSS feed

arXiv AI
Aug 11

Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generation

arXiv:2510. 21891v2 Announce Type: replace-cross Abstract: To deploy large language models (LLMs) in high-stakes application domains that require substantively accurate responses to open-ended prompts, we need reliable, computationally inexpensive methods that assess the trustworthiness of long-form responses generated by LLMs.

By Dhrupad Bhardwaj, Julia Kempe, Tim G. J. Rudner
arXiv AI
Aug 11

Back to the Future: A workbook time machine for spread sheet creation benchmarks

arXiv:2608. 07873v1 Announce Type: new Abstract: We introduce the workbook time machine, a pipeline that automatically creates benchmarks evaluating the ability of language models to create derived objects in spreadsheets (formulas, charts, pivot tables, and conditional formatting).

By Mansi Uniyal, Agamdeep Singh, Ananya Singha, Priyanshu Gupta, Mukul Singh, Gust Verbruggen, Vu Le, Sumit Gulwani