arXiv AI
Sep 1

Look It Up: Analysing Internal Web Search Capabilities of Modern LLMs

The paper evaluates how modern large language models use internal web search to answer factual questions. Using 783 static queries and 288 dynamic queries, the authors find that enabling retrieval improves accuracy on static questions but hurts confidence calibration. On dynamic queries, models often retrieve but still achieve less than 70% accuracy, mainly due to poor query formulation and source selection, indicating that internal web search works better as a quick verification tool than a full information‑retrieval system.

By Sahil Kale
arXiv Machine Learning
Sep 3

Multi-Agent Retrieval-Augmented Generation for Efficient Cloud Knowledge Base Search in Telecom SNOC Environment

The paper introduces Athena for Cloud Knowledge Base, a fully offline multi‑agent Retrieval Augmented Generation (RAG) system tailored for Vodafone Idea’s Telecom SNOC environment. It combines dense E5 Large V2 embeddings, BM25 sparse retrieval, and Knowledge Graph expansion, fusing results with Weighted CombSUM, cross‑encoder reranking, and MMR to produce a diverse evidence set. The framework further verifies each chunk with an LLM before response generation, discarding weak evidence and falling back to multi‑chunk evaluation when necessary, achieving an MRR@10 of 0.910 and an EM of 78.4% on a 4,200‑document corpus.

By Harish Saragadam, Sudhanshu Sharma, Ipsha Routray
arXiv Computation and Language
Aug 27

Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG

Corpus2Skill is a retrieval architecture that transforms an enterprise knowledge base into a hierarchical skill directory, enabling an LLM agent to navigate from high-level summaries to specific documents and backtrack when necessary. On an enterprise customer‑support benchmark, it outperforms single‑shot dense, hybrid, hierarchical‑retrieval, and agentic RAG baselines in answer quality and grounding, with a moderate cost tradeoff. An eleven‑dataset study shows that corpus navigation excels on single‑domain corpora with a recoverable topical taxonomy but is less effective on open‑domain factoid pools or homogeneous‑tabular corpora, providing a design guideline for knowledge‑grounded systems.

By Yiqun Sun, Pengfei Wei, Lawrence B. Hsieh