arXiv Machine Learning

Cross-lingual Functional Vectors for Emotion Detection in Large Language Models

arXiv AI
2d ago

Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models

The study examines how emotions are represented across layers of large language models (LLMs) by probing eight 1B–9B open‑weight models on three datasets (Twitter, Reddit, autobiographical narratives). It finds that the optimal probing layer varies systematically with the dataset, moving from near‑input layers to deeper layers, and that targeted forward‑pass interventions on these layers degrade performance more than random interventions. Additionally, the selected layers transfer across datasets and emotion categories, and early‑exit representations from these layers outperform full‑depth exits by an average of 6.9 percentage points.

By Tian Fang, Ga\"el Guibon, Davide Buscaldi
arXiv AI
1d ago

Beyond Transfer Accuracy: Mechanism-Guided Controlled Adaptation for Low-Resource Languages

The paper introduces a method that adapts Contextual Decomposition for Transformers (CD‑T) to discover neural circuits without relying on clean counterfactuals, using label‑balanced activation means and task‑directional relevance scoring. These circuits are then employed in Circuit‑Targeted Supervised Fine‑Tuning (CT‑SFT), which restricts parameter updates to task‑relevant heads and LayerNorm, leading to competitive performance on low‑resource language adaptation tasks such as NusaX cross‑lingual sentiment transfer. CT‑SFT consistently avoids catastrophic forgetting and preserves source‑language and related‑task performance, offering a more controlled alternative to global fine‑tuning, as further validated on the XNLI benchmark.

By Khumaisa Nur'aini, Ayu Purwarianti, Alham Fikri Aji, Derry Wijaya
arXiv Computation and Language
Aug 25

Benchmarking and Boosting Multilingual Capabilities of LVLMs via OCR-Centric Reinforcement Learning

The paper introduces PM4Bench, a multimodal, multilingual, multi-task benchmark built on a strictly parallel 10‑language corpus, allowing fair cross‑lingual comparison of Large Vision‑Language Models (LVLMs). It also proposes a vision setting that embeds textual inputs directly into images to better mimic real deployment scenarios. Experiments show OCR performance drives cross‑lingual gaps, leading to an OCR‑centric GRPO training strategy that improves multilingual VQA and reduces disparities without costly supervision.

By Junyuan Gao, Jiahe Song, Jiang Wu, Runchuan Zhu, Guanlin Shen, Shasha Wang, Xingjian Wei, Haote Yang, Weijia Li, Bin Wang, Lijun Wu, Conghui He
Hugging Face Trending Papers
Jul 14

Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters?

Recent advances in multimodal large language models (MLLMs) have significantly improved the performance of multimodal emotion recognition (MER) and enabled interpretable description generation by jointly modeling video, audio, and language, etc. However, these performance improvements are often accompanied by an increase in model parameter size (e.