arXiv AI By Rishiraj Sengupta, Sotiris Chatzimiltis, Mohammad Shojafar, Xiatian Zhu

Free-Text Evaluation of LLMs for 5G Domain Knowledge and Fault Analysis using LLM-as-Judge

Read the original on arXiv AI →

The paper evaluates lightweight, edge‑deployable large language models—Claude‑Haiku‑4.5, GPT‑5.4‑Mini, and Gemini‑3.1‑Flash‑Lite—on free‑text 5G domain knowledge and fault‑analysis tasks using three benchmarks (TeleQNA ORAN FT, 5G‑Faults FT, TeleInter FT). All models achieve at least 90% accuracy on fault diagnosis, but zero‑shot recall of 3GPP and O‑RAN specifications remains below 60%. Multi‑judge scoring yields a mean inter‑judge agreement of at least 0.90, and Gemini‑3.1‑Flash‑Lite emerges as the most efficient model for production telecom deployments.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
Aug 28

TelecomGPT-R1: A Unified Open-Source Reasoner for the Telecom Stack

TelecomGPT‑R1‑9B is an open‑source large language model designed specifically for telecom reasoning tasks. It was trained on a 67,427‑example supervised fine‑tuning corpus that covers protocol, knowledge, modeling, and fault reasoning, and further refined with a two‑stage post‑training process involving low‑rank adaptation and policy optimization. The model tops the GSMA open telco leaderboard and matches state‑of‑the‑art closed‑source reasoners across seven public telecom benchmarks.

By Bohao Wang, Chenwei Wu, Haoyu Li, Hang Zou, Yu Tian, Lina Bariah, Li Wei, Chongwen Huang, Yongliang Shen, Zhaoyang Zhang, Merouane Debbah
arXiv Machine Learning
Sep 2

CRAFT: Fine-Tuning Pre-hoc Explainability in AI-native 6G RAN

The paper introduces CRAFT, a data‑centric fine‑tuning approach that aligns small language models (SLMs) for pre‑hoc reasoning in AI‑native 6G radio access networks (RAN). By automatically generating verified (input, trace, label) triplets and fine‑tuning with low‑rank adaptation, CRAFT achieves high accuracy and F1 scores on TRACTOR and IC xApp datasets while avoiding parse failures that plague RL methods like GRPO. It also reduces energy consumption by 59% compared to GRPO baselines, offering a more sustainable path to auditable AI in 6G RAN.

By Pranshav Gajjar, Vijay K Shah
arXiv AI
Sep 3

Large Language Models (LLMs) for Telecom Root Cause Analysis (RCA): A Structured Reasoning Framework for Evidence-Grounded Diagnosis

The paper introduces a structured reasoning framework that leverages large language models (LLMs) for root cause analysis (RCA) in telecom networks. It organizes heterogeneous network telemetry into canonical contexts, enforces decision‑path reasoning, and produces evidence‑grounded explanations to improve fault identification. Experiments on two 5G RCA datasets, TeleLogs and TelecomTS, show that this approach consistently outperforms baseline techniques in diagnostic accuracy and decision consistency.

By Hao Zhou (Jianzhong), Mandar Kulkarni (Jianzhong), Hao Chen (Jianzhong), Yan Xin (Jianzhong), Charlie (Jianzhong), Zhang
Hugging Face Trending Papers
Sep 2

Large Language Models (LLMs) for Telecom Root Cause Analysis (RCA): A Structured Reasoning Framework for Evidence-Grounded Diagnosis

The paper discusses the challenges of root cause analysis (RCA) in 5G and 6G telecom networks, where complex cross-layer dependencies make diagnosis difficult. It reviews the progression from rule‑based and machine‑learning RCA methods to emerging large language model (LLM) approaches, highlighting issues such as hallucination and unstable reasoning when using vanilla LLMs. The authors propose a structured reasoning framework that organizes network telemetry into canonical contexts, enforces decision‑path reasoning, and generates evidence‑grounded explanations, showing improved diagnostic accuracy on two 5G RCA datasets.