Optimizing your LLM in production

Investing in Performance: Fine-tune small models with LLM insights - a CFM case study

Efficient Request Queueing – Optimizing LLM Performance

Understanding and Coding the KV Cache in LLMs from Scratch

KV caches are one of the most critical techniques for efficient inference in LLMs in production.

How Long Prompts Block Other Requests - Optimizing LLM Performance

Making thousands of open LLMs bloom in the Vertex AI Model Garden

Preference Tuning LLMs with Direct Preference Optimization Methods