arXiv AI June 8, 2026 By Jiahui Geng, Fengyu Cai, Shaobo Cui, Qing Li, Liangwei Chen, Chenyang Lyu, Haonan Li, Derui Zhu, Walter Pretschner, Heinz Koeppl, Fakhri Karray

CoQuIR: A Comprehensive Benchmark for Code Quality-Aware Information Retrieval

Read the original on arXiv AI →

arXiv:2506. 11066v3 Announce Type: replace-cross Abstract: Code retrieval is essential in modern software development, as it boosts code reuse and accelerates debugging.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

benchmarks

arXiv AI

Jun 16

AlignCoder: Aligning Retrieval with Target Intent for Repository-Level Code Completion

arXiv:2601. 19697v2 Announce Type: replace-cross Abstract: Repository-level code completion remains a challenging task for existing code large language models (code LLMs) due to their limited understanding of repository-specific context and domain knowledge.

By Tianyue Jiang, Yanli Wang, Yanlin Wang, Daya Guo, Ensheng Shi, Yuchi Ma, Jiachi Chen, Zibin Zheng

llms rag reinforcement-learning benchmarks

arXiv Machine Learning

Jun 29

Recall Before Rerank: Benchmarking Deep Learning Models for Large-Scale Code-to-Code Retrieval

arXiv:2606. 27401v1 Announce Type: cross Abstract: Semantic code search and clone detection are essential for software development, maintenance, and reuse.

By Leonardo Venuta, Francesco Tosoni, Paolo Ferragina

llms benchmarks

arXiv AI

Jul 3

XSearch: Explainable Code Search via Concept-to-Code Alignment

arXiv:2605. 16046v2 Announce Type: replace-cross Abstract: Semantic code search has been widely adopted in both academia and industry.

By Yiming Liu, Ruofan Liu, Yun Lin, Zicong Zhang, Weiyu Kong, Pengnian Qi, Xiao Cheng, Weinan Zhang, Qianxiang Wang, Linpeng Huang

rag benchmarks safety

arXiv AI

Jul 17

Large Language Models for Code Generation from Multilingual Prompts: A Curated Benchmark and a Study on Code Quality

arXiv:2607. 14816v1 Announce Type: cross Abstract: Large Language Models (LLMs) perform differently on identical programming tasks when prompted in different natural languages, a phenomenon known as language bias.

By Saima Afrin, Alessandro Midolo, Camilo Escobar-Vel\'asquez, Mario Linares-V\'asquez, Weiyuan Ding, Bowen Xu, Massimiliano Di Penta, Antonio Mastropaolo

llms benchmarks safety

arXiv Machine Learning

Aug 11

Themis: Training Robust Multilingual Code Reward Models for Flexible Multi-Criteria Scoring

arXiv:2605. 00754v4 Announce Type: replace-cross Abstract: Reward models (RMs) have become an indispensable fixture of the language model (LM) post-training playbook, enabling policy alignment and test-time scaling.

By Indraneil Paul, Goran Glava\v{s}, Iryna Gurevych

llms reinforcement-learning benchmarks safety

arXiv AI

Jun 12

HybridCodeAuthorship: A Benchmark Dataset for Line-Level Code Authorship Detection

arXiv:2606. 12620v1 Announce Type: cross Abstract: Thanks to the rapid adoption of AI code assistants powered by large language models (LLMs), industry codebases are, increasingly, a hybrid of AI- and human-authored code.

By Luke Patterson, Li Wang, Adam Faulkner

llms benchmarks

Related stories

AlignCoder: Aligning Retrieval with Target Intent for Repository-Level Code Completion

Recall Before Rerank: Benchmarking Deep Learning Models for Large-Scale Code-to-Code Retrieval

XSearch: Explainable Code Search via Concept-to-Code Alignment

Large Language Models for Code Generation from Multilingual Prompts: A Curated Benchmark and a Study on Code Quality

Themis: Training Robust Multilingual Code Reward Models for Flexible Multi-Criteria Scoring

HybridCodeAuthorship: A Benchmark Dataset for Line-Level Code Authorship Detection