arXiv AI
Jun 18

Improve Large Language Model Systems with User Logs

arXiv:2602. 06470v3 Announce Type: replace-cross Abstract: Scaling training data and model parameters has long driven progress in large language models (LLMs), but this paradigm is increasingly constrained by the scarcity of high-quality data and diminishing returns from rising computational costs.

By Changyue Wang, Weihang Su, Qingyao Ai, Xingzhao Yue, Rui Zhang, Xiaojia Chang, Yiqun Liu
arXiv Machine Learning
Oct 22

Code Comprehensor: Hierarchical Documentation and Cross-Modal Retrieval for Large Repositories

Code Comprehensor is a hybrid retrieval‑reasoning framework designed to aid understanding of large codebases. It combines a code dependency callgraph, CodeScribe—which generates hierarchical documentation using code‑aware LLMs—and CodeContrast, a CLIP‑style dual‑encoder that learns aligned text‑code embeddings for fast, semantically precise retrieval. Experiments on OpenCV and a 5M‑LOC proprietary repository show that CodeScribe‑derived supervision improves cross‑modal retrieval accuracy, and LLM‑based evaluation reports over 90% faithfulness.

By Sujoy Roychowdhury, Joseph H. R. Isaac, Jiangning Gao, Martin Klitte, Diarmuid Corcoran