Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

StarCoder: A State-of-the-Art LLM for Code

CodeGemma - an official Google release for code LLMs

Understanding the 4 Main Approaches to LLM Evaluation (From Scratch)

Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples

Open LLM Leaderboard: DROP deep dive

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

FLARE: Fine-Grained Diagnostic Feedback for LLM Code Refinement

arXiv:2606. 03852v1 Announce Type: cross Abstract: Large language models often generate code with bugs.

BigCodeArena: Judging code generations end to end with code executions

Introducing the Open Leaderboard for Japanese LLMs!

Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard

BigCodeBench: The Next Generation of HumanEval

An Introduction to AI Secure LLM Safety Leaderboard

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

Today's LLMs are susceptible to prompt injections, jailbreaks, and other attacks that allow adversaries to overwrite a model's original instructions with their own malicious prompts.