HelaBERT: Enhancing Sinhala Language Understanding with Dual Pooling Classification Head
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The paper introduces a hybrid BERT‑CNN‑BiLSTM model for simultaneously classifying Bangla news headlines and performing sentiment analysis. Using the BAN‑ABSA dataset of 9,014 headlines, the authors compare two sampling strategies and report headline accuracy up to 81.37 % and sentiment accuracy up to 73.43 %. The proposed framework outperforms baseline models and establishes new state‑of‑the‑art results for Bangla headline classification and sentiment analysis.
arXiv:2609.36194v1 Announce Type: new Abstract: Extracted sentiment directions can vary across samples even when downstream sentiment classification remains accurate. To evaluate direction reproducib...
The paper introduces SinLlama, the first decoder‑based open‑source large language model with explicit support for Sinhala. By extending Llama‑3‑8B, adding Sinhala‑specific tokenizer vocabulary, and performing continual pre‑training on a cleaned 10‑million‑token Sinhala corpus, the authors created a model that surpasses both the base and instruction‑fine‑tuned variants of Llama‑3‑8B on three text classification tasks. This work addresses the underrepresentation of low‑resource languages in open‑source LLMs.
NEPSEE is a Nepali sentiment analysis benchmark created by having two annotators independently label 5,614 tweets from Nepali public figures on a five‑point scale. Only 3,189 sentences with identical polarity are kept for a three‑class version, while 766 sentences with adjacent labels are used in a five‑point task. Baseline results show NepBERTa achieving a macro‑F1 of 0.877 on the three‑class benchmark, with commercial LLMs performing similarly; on the five‑point task, Claude Opus 5.5 outperforms encoders by 0.10–0.12 macro‑F1, and a tokenizer audit reveals that restoring Devanagari vowel signs can significantly alter performance.
arXiv:2609.37882v1 Announce Type: cross Abstract: Every text classifier for an African language begins with a budgeting question: how many labelled examples are needed, and can labels from other Afri...
arXiv:2012. 02110v2 Announce Type: replace-cross Abstract: Pre-trained language models have significantly advanced natural language processing (NLP), especially with the introduction of BERT and its optimized version, RoBERTa.