arXiv Machine Learning

BanglaMamba: Exploring State Space Models for Bangla Fake News Detection

BanglaMamba explores Mamba-based State Space Models (SSMs) as a computationally efficient alternative for Bangla fake news detection. Compared to BanglaBERT and a custom BERT trained from scratch, BanglaMamba achieves a Macro‑F1 score of 0.9029, close to the 0.9057 of the custom BERT, while delivering 2.2× higher inference throughput and 49% lower peak GPU memory usage. Cross‑dataset evaluation shows BanglaBERT generalizes better, underscoring the value of large‑scale pretraining.

arXiv Machine Learning
Aug 24

MIL-BERT: Classification of Arbitrarily Large Text with Performance and Explanatory Guarantees

MIL-BERT is a neural network algorithm that classifies large texts by selecting relevant excerpts, inspired by multiple instance learning. It scales to samples with nearly 1 million tokens and has been evaluated on seven datasets, achieving state‑of‑the‑art results on three long‑text tasks such as political bias detection, trigger warning identification, and author demographic inference. The model also generalizes from weakly‑labeled text bags to accurately classify smaller instances.

By John Cadigan, Dayne Freitag, Eric Yeh
arXiv Computation and Language
5d ago

Beyond Global Scalars: Synergizing Token-Level Statistics and Deep Semantics for Adversarial AIGC Text Detection

The paper introduces MOSAIC, a large adversarial benchmark for detecting AI-generated text, and presents NeuroStat, a new framework that combines token‑level probabilistic logits with deep semantic hidden states from a single language model. NeuroStat fuses these signals via Macro‑State Residual Modulation and uses orthogonal and contrastive losses to learn complementary representations. Experiments show that NeuroStat outperforms existing methods on MOSAIC, achieving superior robustness against adversarial attacks.

By Peiming Li, Yifan Wang, Zhiyuan Hu, Shiyu Li, Zheng Wei, Yang Tang