SentenceETM is a neural topic model that assigns a topic to each sentence by jointly using lexical and contextual evidence. It represents each topic with a vocabulary distribution via word embeddings and a Gaussian over sentence embeddings in a topic‑specific low‑dimensional subspace. The model exactly marginalizes the sentence topic, combining word and embedding evidence, and uses amortized variational inference for document proportions while re‑estimating Gaussian parameters in closed form.
By Federica Granese, Serena Villata, Charles Bouveyron
TopiCLEAR is a framework that clusters document or sentence embeddings using adaptive dimensionality reduction to uncover low‑dimensional geometric structures that correspond to human‑interpretable topics. The method is evaluated on four benchmark datasets, showing strong agreement with human annotations, especially for short and informal texts. A Twitter case study demonstrates that TopiCLEAR yields more interpretable topics than LDA, recovering both annotated topic structure and coherent sub‑topics.
By Aoi Fujita, Taichi Yamamoto, Yuri Nakayama, Ryota Kobayashi
Sequence models can generalise in fundamentally distinct ways: extrapolating structures seen in training, or using their prompt to adapt to novel tasks. The prevailing strategy determines how the mode...
arXiv:2512. 10092v2 Announce Type: replace Abstract: Analyzing large-scale text corpora is a core challenge in machine learning, crucial for tasks like identifying undesirable model behaviors or biases in training data.
By Nick Jiang, Xiaoqing Sun, Lisa Dunlap, Lewis Smith, Neel Nanda
arXiv:2603.04317v2 Announce Type: replace-cross
Abstract: A growing literature shows that variables can be linearly decoded from the activations of large language models (LLMs). These range from prop...
By Elan Barenholtz
The paper introduces MARETopic, a training‑free framework that identifies topics by selecting rank‑based prototype documents from pretrained embeddings. By projecting embeddings onto a low‑dimensional manifold and building ranked neighborhood lists, a greedy algorithm picks exactly K exemplar texts whose neighborhoods cover the corpus. Two variants—MARETopic_Corr, which uses a query‑performance predictor and rank correlation, and MARETopic_Diff, which employs a rank‑based diffusion matrix—achieve higher purity and NMI on benchmark datasets and run significantly faster, while also improving topic coherence and vocabulary diversity through a novel Maximal Marginal Relevance step.
By Thiago C\'esar Castilho Almeida, Daniel Carlos Guimar\~aes Pedronette