How to train a Language Model with Megatron-LM

How to train a new language model from scratch using Transformers and Tokenizers

Training a language model with 🤗 Transformers using TensorFlow and TPUs

Very Large Language Models and How to Evaluate Them

The State Of LLMs 2025: Progress, Problems, and Predictions

A 2025 review of large language models, from DeepSeek R1 and RLVR to inference-time scaling, benchmarks, architectures, and predictions for 2026.

SmolVLM - small yet mighty Vision Language Model

Evaluating large language models trained on code

The Reformer - Pushing the limits of language modeling

Efficient training of language models to fill in the middle

Red-Teaming Large Language Models

Dango: A Strictly L1-Only Large Language Model for Studying Second Language Acquisition

We introduce Dango, a 1. 8B-parameter large language model designed for controlled studies of L1-to-L2 (Japanese-to-English) transfer in second language acquisition (SLA).

RELISH: LLM REgression with a Latent Iterative State Head

arXiv:2604. 01206v2 Announce Type: replace-cross Abstract: We present RELISH (REgression with a Latent Iterative State Head), a novel, lightweight architecture designed for text regression with large language models.

Databricks ❤️ Hugging Face: up to 40% faster training and tuning of Large Language Models