arXiv Computation and Language

Typological Feature Prediction with Large Language Models: An In-Context Learning Approach

The paper explores how large language models (LLMs) can predict typological features using an in-context learning approach with data from URIEL+ and Glottolog. Zero‑shot prompting alone is inadequate, but providing phylogenetic and geographic neighbour evidence enables LLMs to outperform all baselines, even for low‑resource languages. Additionally, most LLM rationales align with the supplied evidence, suggesting a move toward explainable predictions.

Hugging Face Trending Papers
Sep 3

Typological Feature Prediction with Large Language Models: An In-Context Learning Approach

The paper explores how large language models (LLMs) can predict typological features using an in-context learning approach with data from URIEL+ and Glottolog. Zero‑shot prompting alone is inadequate, but providing phylogenetic and geographic neighbour evidence enables LLMs to outperform all baselines, even for low‑resource languages. Additionally, most LLM rationales align with the supplied evidence, suggesting a move toward explainable typological predictions.

Hugging Face Trending Papers
Jun 2

From Script to Semantics: Prompting Strategies for African NLI

Large language models (LLMs) are increasingly evaluated in multilingual settings, yet their inference behavior in low-resource African languages remains underexplored especially under pure prompting without fine-tuning. We present a systematic study of prompting strategies for Natural Language Inference (NLI) in Swahili, Yoruba, and Hausa using the AfriXNLI benchmark.

arXiv AI
Jun 26

Metaphors are a Source of Cross-Domain Misalignment of Large Reasoning Models

arXiv:2601. 03388v3 Announce Type: replace-cross Abstract: Earlier research has shown that metaphors influence human decision-making, raising the question of whether metaphors also influence large language models (LLMs)' reasoning pathways, given that their training data contain a large number of metaphors.

By Zhibo Hu, Chen Wang, Yanfeng Shu, Hye-young Paik, Liming Zhu
arXiv AI
Sep 10

Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation

The paper introduces Fact-Ablated Evaluation (FAE), a framework that iteratively removes cited evidence to test whether large language models (LLMs) adjust their fact‑checking predictions accordingly. Experiments reveal that many off‑the‑shelf LLMs rely more on internal knowledge than on the provided evidence. To address this, the authors propose REAL, a training method that uses counterfactual evidence supervision to encourage LLMs to base veracity judgments on evidence, achieving better evidence‑dependent performance across four datasets.

By Xingyu Deng, Mingzi Cao, Nikolaos Aletras, Xi Wang, Mark Stevenson
arXiv Machine Learning
2d ago

It's All Training: A Fully Synthetic Single-Stage Recipe for LLMs

arXiv:2609.37891v1 Announce Type: cross Abstract: Current pre-training datasets are derived from web crawls, with all their issues, and were not designed to support mid- and post-training pipelines--...

By Pierre-Carl Langlais, Pieter Delobelle, Yannick Detrois, Pavel Chizhov, Carlos Rosas-Hinostroza, Neil Si Smail, Benjamin Burtin, Hanna Shcharbakova, Ivan Yamshchikov, Anastasia Stasenko
arXiv Computation and Language
Sep 4

To What Extent Do Large Language Models Understand Bangla Idioms?

The paper introduces the first large‑scale benchmark dataset of Bangla idioms, along with a synthetic multiple‑choice question set for idiom meaning identification. It evaluates recent large language models on three idiom‑related tasks—paraphrasing, idiom span detection, and meaning identification—using zero‑shot and few‑shot prompting. Results show significant variability across models, with Phi‑4‑mini‑instruct best at paraphrasing, Kimi‑K2‑32b‑instruct excelling at span detection, and Gemini‑2.5‑flash leading in meaning identification.

By Mousumi Akter, Md. Faiyaz Abdullah Sayeedi, Nurul Labib Sayeedi, Swakkhar Shatabda