A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Overview of natively supported quantization schemes in 🤗 Transformers

Introducing Optimum: The Optimization Toolkit for Transformers at Scale

Memory-efficient Diffusion Transformers with Quanto and Diffusers

On the Expressive Power of Transformers

arXiv:2608. 12671v1 Announce Type: new Abstract: Multi-layer transformers form the critical component of essentially all large language models (LLMs) in use today.

Modern analog computing for solving differential and matrix equations

arXiv:2606. 13179v1 Announce Type: cross Abstract: In recent years, driven by the computational demands of data-intensive applications such as artificial intelligence and scientific computing, analog computing has gained renewed interest.

Native-speed vLLM transformers modeling backend