Native-speed vLLM transformers modeling backend

Introducing Optimum: The Optimization Toolkit for Transformers at Scale

Hyperloop Transformers

arXiv:2604. 21254v3 Announce Type: replace Abstract: LLM architecture research generally aims to maximize model quality subject to fixed compute/latency budgets.

The Transformers Library: standardizing model definitions

On the Expressive Power of Transformers

arXiv:2608. 12671v1 Announce Type: new Abstract: Multi-layer transformers form the critical component of essentially all large language models (LLMs) in use today.

Transformers backend integration in SGLang

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Porting fairseq wmt19 translation system to transformers

Stability of Transformers under Layer Normalization

arXiv:2510. 09904v2 Announce Type: replace-cross Abstract: Despite their widespread use, training deep Transformers can be unstable.

Accelerating Transformers Fine-Tuning with NVIDIA NeMo AutoModel

How we sped up transformer inference 100x for 🤗 API customers

Overview of natively supported quantization schemes in 🤗 Transformers

Differential Transformer V2