arXiv Machine Learning August 18, 2026 By Rinit Jain, Tirthraj Mahajan, Advait Joshi, Raviraj Joshi

L3Cube-IndicQuest v2: A Large-Scale Multilingual Benchmark for Evaluating Factual Knowledge of Large Language Models Across Indic Languages

Read the original on arXiv Machine Learning →

arXiv:2608. 15535v1 Announce Type: cross Abstract: We present L3Cube-IndicQuest v2, a large-scale gold-standard multilingual question-answering benchmark for evaluating the India-specific factual knowledge of Large Language Models (LLMs).

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers

Jul 23

When Trivia Is Not Trivial: Everyday Knowledge Failures in Multilingual LLMs

Quiz rooms, trivia nights, and quiz shows challenge human knowledge across a wide range of topics, from canonical facts to everyday culture. In this paper, we examine whether large language models (LLMs) can perform competitively in such settings, using quiz-style questions to test them on both common and niche topics.

llms benchmarks

arXiv AI

Jun 10

RankLLM: Weighted Ranking of LLMs by Quantifying Question Difficulty

arXiv:2602. 12424v2 Announce Type: replace-cross Abstract: Benchmarks establish a standardized evaluation framework to systematically assess the performance of large language models (LLMs), facilitating objective comparisons and driving advancements in the field.

By Ziqian Zhang, Xingjian Hu, Yue Huang, Kai Zhang, Ruoxi Chen, Yixin Liu, Qingsong Wen, Kaidi Xu, Xiangliang Zhang, Neil Zhenqiang Gong, Lichao Sun

llms benchmarks

arXiv Machine Learning

Jul 28

IKS-Instruct: A 24,000-Example Multilingual Dataset for Teaching Language Models Indian Knowledge Systems

arXiv:2607. 23322v1 Announce Type: cross Abstract: Instruction tuning has become the standard method for adapting large language models to follow human intent, yet existing instruction datasets are dominated by English-language general-knowledge tasks and lack coverage of specialized pedagogical domains.

By Shwetha Singaravelu, Gayathri Muruganantham, Lakshmi Rajendran, Santhosh Sivasubramani

llms fine-tuning

arXiv AI

1d ago

LLMs Get Smarter from Targeted Synthetic Multilingual Data

arXiv:2608. 15964v1 Announce Type: cross Abstract: Language-specific competency (LSC) is the phenomenon of a language model performing better or worse depending on the language of the prompt.

By Ishika Agarwal, Arkajyoti Charaborty, Tanner Sorensen, Neha Gupta, Andreas Stolcke

llms fine-tuning

arXiv Machine Learning

Jun 25

Shared Doubt: Zero-Shot Cross-Lingual Confidence Estimation for Language Models

arXiv:2605. 31220v2 Announce Type: replace-cross Abstract: Confidence estimation (CE), i.

By Athina Kyriakou, Dennis Ulmer, Ivan Titov

llms nlp

arXiv AI

Jul 29

Comparing RAG and GraphRAG for Page-Level Retrieval Question Answering on a Math Textbook

arXiv:2509. 16780v3 Announce Type: replace-cross Abstract: Large language models (LLMs) show promise as educational aids but often lack alignment with specific course materials.

By Eason Chen, Chuangji Li, Eric Li, Zimo Xiao, Jionghao Lin, Kenneth R. Koedinger

llms rag nlp safety

Related stories

When Trivia Is Not Trivial: Everyday Knowledge Failures in Multilingual LLMs

RankLLM: Weighted Ranking of LLMs by Quantifying Question Difficulty

IKS-Instruct: A 24,000-Example Multilingual Dataset for Teaching Language Models Indian Knowledge Systems

LLMs Get Smarter from Targeted Synthetic Multilingual Data

Shared Doubt: Zero-Shot Cross-Lingual Confidence Estimation for Language Models

Comparing RAG and GraphRAG for Page-Level Retrieval Question Answering on a Math Textbook