Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard

Understanding the 4 Main Approaches to LLM Evaluation (From Scratch)

Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples

Judge Arena: Benchmarking LLMs as Evaluators

Open LLM Leaderboard: DROP deep dive

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face

Make LLM Fine-tuning 2x faster with Unsloth and 🤗 TRL

📚 3LM: A Benchmark for Arabic LLMs in STEM and Code

What's going on with the Open LLM Leaderboard?

Llama 2 on Amazon SageMaker a Benchmark

LLMVisor: A Real-Time Latency Attribution Model for Multi-Tenant LLM Serving

arXiv:2608. 08382v1 Announce Type: new Abstract: As LLM inference shifts to multi-tenant GPU clusters, co-batching improves throughput but obscures per-tenant usage and limits control.

Understanding and Coding the KV Cache in LLMs from Scratch

KV caches are one of the most critical techniques for efficient inference in LLMs in production.

Welcome Llama 3 - Meta's new open LLM