Hugging Face Blog
How we sped up transformer inference 100x for 🤗 API customers
Read the original on Hugging Face Blog →The Flow has not summarised this story yet — read it at Hugging Face Blog.
Related stories
Hugging Face Blog
May 10, 2022
Accelerated Inference with Optimum and Transformers Pipelines
Hugging Face Blog
Jul 1, 2024
Our Transformers Code Agent beats the GAIA benchmark 🏅
Hugging Face Blog
May 13, 2024
License to Call: Introducing Transformers Agents 2.0
Hugging Face Blog
Sep 12, 2023
Overview of natively supported quantization schemes in 🤗 Transformers
arXiv Machine Learning
Aug 13
Small-Scale Experiments: Are We There Yet?
arXiv:2608. 11859v1 Announce Type: new Abstract: Scaling laws promised cost-effective experiments; six years later, they have yet to fully deliver.
arXiv Machine Learning
Jun 26
At the Edge of Understanding: Sparse Autoencoders Trace The Limits of Transformer Generalization
arXiv:2606. 26396v1 Announce Type: new Abstract: Pre-trained transformers have demonstrated remarkable generalization abilities, at times extending beyond the scope of their training data.