Open ASR Leaderboard: Trends and Insights with New Multilingual & Long-Form Tracks

Introducing the FFASR Leaderboard: Benchmarking ASR in the Real World

Introducing the Open FinLLM Leaderboard

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Open LLM Leaderboard: DROP deep dive

Introducing the Open Chain of Thought Leaderboard

Introducing the Open Arabic LLM Leaderboard

Arabic Leaderboards: Introducing Arabic Instruction Following, Updating AraGen, and More

The Open Arabic LLM Leaderboard 2

Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages

arXiv:2607. 23808v1 Announce Type: cross Abstract: In this work, we introduce Indic DiarBench, a speaker diarization and ASR benchmark dataset spanning all 22 scheduled languages of India.

MTEB-BR: A Text Embedding Benchmark for Brazilian Portuguese

arXiv:2607. 04581v2 Announce Type: replace-cross Abstract: Text embeddings for Portuguese have no dedicated benchmark: evaluation rests on translated corpora such as English MS MARCO or on thin multilingual coverage, with native tasks scattered and unconsolidated.

Introducing the Open Leaderboard for Japanese LLMs!

MTEB-PT: A Text Embedding Benchmark for Brazilian Portuguese

arXiv:2607. 04581v1 Announce Type: cross Abstract: Text embeddings for Portuguese have no dedicated benchmark: evaluation rests on translated corpora such as English MS MARCO or on thin multilingual coverage, with native tasks scattered and unconsolidated.