TopiCLEAR is a framework that clusters document or sentence embeddings using adaptive dimensionality reduction to uncover low‑dimensional geometric structures that correspond to human‑interpretable topics. The method is evaluated on four benchmark datasets, showing strong agreement with human annotations, especially for short and informal texts. A Twitter case study demonstrates that TopiCLEAR yields more interpretable topics than LDA, recovering both annotated topic structure and coherent sub‑topics.
By Aoi Fujita, Taichi Yamamoto, Yuri Nakayama, Ryota Kobayashi
arXiv:2507. 23220v2 Announce Type: replace-cross Abstract: Traditional topic models are effective at uncovering latent themes in large text collections.
By Carolina Zheng, Nicolas Beltran-Velez, Sweta Karlekar, Claudia Shi, Achille Nazaret, Asif Mallik, Amir Feder, David M. Blei
Dynamic Embedded Topic Models (D-ETM) are extended to enable stable cross‑corpus temporal analysis by first learning a shared dynamic topic space—called the shared backbone—over a merged multi‑corpus collection. Corpus‑specific residual adaptation is then applied around this frozen backbone, allowing each corpus to specialize lexically without creating separate latent topic spaces. Experiments on three corpora spanning 97 years show that this approach yields much stronger alignment of topic trajectories (97.5 ± 0.7 % Retrieval@1) compared to full fine‑tuning or independent training with post‑hoc matching.
By Ruoxuan Li, Bruce Kogut
EigenLI introduces a spectral approximation framework that compresses late‑interaction representations by identifying document‑specific low‑dimensional subspaces. By selecting dominant eigendirections, it constructs reduced interaction representations that outperform clustering‑based pooling methods on ColBERTv2 and AnswerAI‑ColBERT‑small. The framework also yields EigenLI‑SV, a single‑vector ANN‑compatible representation that consistently surpasses comparable surrogates such as MUVERA across multiple datasets and text models.
By Archish S, Sabyasachi Basu, Ankit Garg, Ravishankar Krishnaswamy, Kirankumar Shiragur
arXiv:2608. 16269v1 Announce Type: cross Abstract: Recent advances in neural topic models with pre-trained language models (PLMs) have achieved strong performance by leveraging general-domain pre-training, yet their topic interpretability often degrades on specialized corpora.
By Seung-Won Seo, Won Ik Cho, Yongmin Yoo
arXiv:2608.21702v1 Announce Type: new
Abstract: Retrieval-Augmented Generation (RAG) grounds LLM generation on retrieved documents, but the standard terminal retrieval stage--dense-vector similarity,...
By Jing Liu, Yongxing Qi, Muchen Jiang, Chengnan Hu, Qingqing Peng, Haoming Wang, Yuqing Wang, Yang Yu, Xu Zhang, Ting Wu