arXiv AI
Oct 5

A Unified BERT-CNN-BiLSTM Framework for Simultaneous Headline Classification and Sentiment Analysis of Bangla News

The paper introduces a hybrid BERT‑CNN‑BiLSTM model for simultaneously classifying Bangla news headlines and performing sentiment analysis. Using the BAN‑ABSA dataset of 9,014 headlines, the authors compare two sampling strategies and report headline accuracy up to 81.37 % and sentiment accuracy up to 73.43 %. The proposed framework outperforms baseline models and establishes new state‑of‑the‑art results for Bangla headline classification and sentiment analysis.

By Mirza Raquib, Munazer Montasir Akash, Tawhid Ahmed, Saydul Akbar Murad, Farida Siddiqi Prity, Mohammad Amzad Hossain, Asif Pervez Polok, Nick Rahimi
arXiv Computation and Language
Sep 1

SinLlama -- A Large Language Model for Sinhala

The paper introduces SinLlama, the first decoder‑based open‑source large language model with explicit support for Sinhala. By extending Llama‑3‑8B, adding Sinhala‑specific tokenizer vocabulary, and performing continual pre‑training on a cleaned 10‑million‑token Sinhala corpus, the authors created a model that surpasses both the base and instruction‑fine‑tuned variants of Llama‑3‑8B on three text classification tasks. This work addresses the underrepresentation of low‑resource languages in open‑source LLMs.

By H. W. K. Aravinda, Rashad Sirajudeen, Samith Karunathilake, Nisansa de Silva, Surangika Ranathunga, Rishemjit Kaur
arXiv Computation and Language
5d ago

NEPSEE: A Double-Annotated Benchmark for Nepali Sentiment Analysis

NEPSEE is a Nepali sentiment analysis benchmark created by having two annotators independently label 5,614 tweets from Nepali public figures on a five‑point scale. Only 3,189 sentences with identical polarity are kept for a three‑class version, while 766 sentences with adjacent labels are used in a five‑point task. Baseline results show NepBERTa achieving a macro‑F1 of 0.877 on the three‑class benchmark, with commercial LLMs performing similarly; on the five‑point task, Claude Opus 5.5 outperforms encoders by 0.10–0.12 macro‑F1, and a tokenizer audit reveals that restoring Devanagari vowel signs can significantly alter performance.

By Gaurab Baral, Mimansak Nepal, Grishma Basnet
arXiv Machine Learning
Jun 2

GottBERT: a pure German Language Model

arXiv:2012. 02110v2 Announce Type: replace-cross Abstract: Pre-trained language models have significantly advanced natural language processing (NLP), especially with the introduction of BERT and its optimized version, RoBERTa.

By Raphael Scheible, Johann Frei, Fabian Thomczyk, Henry He, Patric Tippmann, Jochen Knaus, Victor Jaravine, Frank Kramer, Martin Boeker