arXiv Machine Learning

Enhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning

The paper investigates how data augmentation can improve sentiment classification on small datasets. Three augmentation techniques—Easy Data Augmentation (EDA), back‑translation, and contextual token substitution—are evaluated with both traditional classifiers (Logistic Regression, Random Forest) and BERT. Results show that all methods boost performance, with contextual augmentation best for BERT and EDA/back‑translation benefiting traditional models.

arXiv AI
Oct 5

A Unified BERT-CNN-BiLSTM Framework for Simultaneous Headline Classification and Sentiment Analysis of Bangla News

The paper introduces a hybrid BERT‑CNN‑BiLSTM model for simultaneously classifying Bangla news headlines and performing sentiment analysis. Using the BAN‑ABSA dataset of 9,014 headlines, the authors compare two sampling strategies and report headline accuracy up to 81.37 % and sentiment accuracy up to 73.43 %. The proposed framework outperforms baseline models and establishes new state‑of‑the‑art results for Bangla headline classification and sentiment analysis.

By Mirza Raquib, Munazer Montasir Akash, Tawhid Ahmed, Saydul Akbar Murad, Farida Siddiqi Prity, Mohammad Amzad Hossain, Asif Pervez Polok, Nick Rahimi
arXiv Computation and Language
Aug 27

KESA: A Knowledge Enhanced Approach For Sentiment Analysis

The paper introduces KESA, a knowledge‑enhanced approach for sentence‑level sentiment analysis that incorporates sentiment knowledge through two auxiliary tasks: sentiment word cloze and conditional sentiment prediction. These tasks use prior sentiment polarity to guide the selection of sentiment words and the prediction of overall sentiment, respectively, and explore label combination methods to unify multiple label types. Experiments show that KESA consistently outperforms pre‑trained models and complements existing knowledge‑enhanced post‑training methods.

By Qinghua Zhao, Shuai Ma, Shuo Ren
arXiv Computation and Language
2d ago

Distilling Literary Sentiment from LLM Annotations into an Ordinal BERT Model

The paper explores using LLM-generated annotations to train smaller BERT models for literary sentiment analysis. Five BERT variants were fine‑tuned with ordinal regression on 10,889 sentences labeled by Gemma 4 31B on a ten‑point scale, and evaluated on 1,923 human‑annotated sentences from Hemingway’s *The Old Man and the Sea*. BERT‑large achieved a Kendall’s τ of 0.589, close to the teacher’s 0.604, and BERT‑base outperformed the teacher on non‑neutral sentences with an MAE of 0.726 versus 1.116.

By Artem Suslov, Takehiro Hashimoto
arXiv AI
Sep 3

Beyond Transfer Accuracy: Mechanism-Guided Controlled Adaptation for Low-Resource Languages

The paper introduces a method that adapts Contextual Decomposition for Transformers (CD‑T) to discover neural circuits without relying on clean counterfactuals, using label‑balanced activation means and task‑directional relevance scoring. These circuits are then employed in Circuit‑Targeted Supervised Fine‑Tuning (CT‑SFT), which restricts parameter updates to task‑relevant heads and LayerNorm, leading to competitive performance on low‑resource language adaptation tasks such as NusaX cross‑lingual sentiment transfer. CT‑SFT consistently avoids catastrophic forgetting and preserves source‑language and related‑task performance, offering a more controlled alternative to global fine‑tuning, as further validated on the XNLI benchmark.

By Khumaisa Nur'aini, Ayu Purwarianti, Alham Fikri Aji, Derry Wijaya
arXiv Machine Learning
Oct 22

Multi-Label Sentiment Analysis on 100 Languages with Dynamic Weighting for Label Imbalance

The paper presents a multi‑label sentiment analysis framework that follows Plutchik’s wheel of emotions and is applicable to 100 languages. It introduces a dynamic weighting scheme to balance class contributions during training, adapts focal loss for harder instances, and derives a linear‑time method for selecting optimal class‑specific thresholds to maximize macro‑F1. Experiments show state‑of‑the‑art performance across multiple languages and metrics, and the authors release the code publicly.

By Selim F. Yilmaz, E. Batuhan Kaynak, Aykut Ko\c{c}, Hamdi Dibeklio\u{g}lu, Suleyman S. Kozat
arXiv AI
Oct 1

BARRAC: Adaptation of an English Aspect-based Sentiment Analysis Approach for Classification Tasks in Arabic Dialects

The paper introduces BARRAC, a method that adapts an English aspect‑based sentiment analysis framework for Arabic dialect classification tasks. It replaces English consumer‑review attribute pools with Arabic linguistic markers for sentiment, sarcasm, and dialect identification, and swaps noisy self‑training for a two‑stage training process. Evaluated on five Arabic dialect datasets, BARRAC achieves a mean macro‑F1 of 63.93%, surpassing the best few‑label state‑of‑the‑art by 3% and outperforming GPT‑4o on four of the five tasks, while error analysis highlights remaining challenges.

By Ali Almutairi, Gelareh Mohammadi, Imran Razzak, Aditya Joshi