Large Language Models: A New Moore's Law?

Understanding the capabilities, limitations, and societal impact of large language models

Very Large Language Models and How to Evaluate Them

Scaling laws for neural language models

On the Smallness of the Large Language Models Scaling Exponents

arXiv:2606. 24504v1 Announce Type: new Abstract: We discuss reasons why the scaling exponents of current Large Language Models (LLMs) applications are indicating an unsustainable regime in terms of energy resources.

The State Of LLMs 2025: Progress, Problems, and Predictions

A 2025 review of large language models, from DeepSeek R1 and RLVR to inference-time scaling, benchmarks, architectures, and predictions for 2026.

Phase transition in large language models and the criticality of natural languages

arXiv:2406. 05335v3 Announce Type: replace-cross Abstract: Generation of text and speech in natural languages can be modeled as a stochastic process.

Block Sparse Matrices for Smaller and Faster Language Models

Introducing The World's Largest Open Multilingual Language Model: BLOOM

Falcon-Edge: A series of powerful, universal, fine-tunable 1.58bit language models.

The Reformer - Pushing the limits of language modeling

Towards Encrypted Large Language Models with FHE

Red-Teaming Large Language Models