arXiv AI By Rishiraj Sengupta, Sotiris Chatzimiltis, Mohammad Shojafar, Xiatian Zhu

Free-Text Evaluation of LLMs for 5G Domain Knowledge and Fault Analysis using LLM-as-Judge

Read the original on arXiv AI →

The paper evaluates lightweight, edge‑deployable large language models—Claude‑Haiku‑4.5, GPT‑5.4‑Mini, and Gemini‑3.1‑Flash‑Lite—on free‑text 5G domain knowledge and fault‑analysis tasks using three benchmarks (TeleQNA ORAN FT, 5G‑Faults FT, TeleInter FT). All models achieve at least 90% accuracy on fault diagnosis, but zero‑shot recall of 3GPP and O‑RAN specifications remains below 60%. Multi‑judge scoring yields a mean inter‑judge agreement of at least 0.90, and Gemini‑3.1‑Flash‑Lite emerges as the most efficient model for production telecom deployments.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
Aug 28

TelecomGPT-R1: A Unified Open-Source Reasoner for the Telecom Stack

TelecomGPT‑R1‑9B is an open‑source large language model designed specifically for telecom reasoning tasks. It was trained on a 67,427‑example supervised fine‑tuning corpus that covers protocol, knowledge, modeling, and fault reasoning, and further refined with a two‑stage post‑training process involving low‑rank adaptation and policy optimization. The model tops the GSMA open telco leaderboard and matches state‑of‑the‑art closed‑source reasoners across seven public telecom benchmarks.

By Bohao Wang, Chenwei Wu, Haoyu Li, Hang Zou, Yu Tian, Lina Bariah, Li Wei, Chongwen Huang, Yongliang Shen, Zhaoyang Zhang, Merouane Debbah
arXiv Machine Learning
Sep 2

CRAFT: Fine-Tuning Pre-hoc Explainability in AI-native 6G RAN

The paper introduces CRAFT, a data‑centric fine‑tuning approach that aligns small language models (SLMs) for pre‑hoc reasoning in AI‑native 6G radio access networks (RAN). By automatically generating verified (input, trace, label) triplets and fine‑tuning with low‑rank adaptation, CRAFT achieves high accuracy and F1 scores on TRACTOR and IC xApp datasets while avoiding parse failures that plague RL methods like GRPO. It also reduces energy consumption by 59% compared to GRPO baselines, offering a more sustainable path to auditable AI in 6G RAN.

By Pranshav Gajjar, Vijay K Shah
arXiv AI
Sep 3

Large Language Models (LLMs) for Telecom Root Cause Analysis (RCA): A Structured Reasoning Framework for Evidence-Grounded Diagnosis

The paper introduces a structured reasoning framework that leverages large language models (LLMs) for root cause analysis (RCA) in telecom networks. It organizes heterogeneous network telemetry into canonical contexts, enforces decision‑path reasoning, and produces evidence‑grounded explanations to improve fault identification. Experiments on two 5G RCA datasets, TeleLogs and TelecomTS, show that this approach consistently outperforms baseline techniques in diagnostic accuracy and decision consistency.

By Hao Zhou (Jianzhong), Mandar Kulkarni (Jianzhong), Hao Chen (Jianzhong), Yan Xin (Jianzhong), Charlie (Jianzhong), Zhang