← Back to all news
arXiv Machine Learning By Farah Adeeba, Miriam Butt

Contextual Embedding Evidence for Main--Light Verb Distinctions in Urdu

Read the original on arXiv Machine Learning →

The study examines Urdu light verbs, which add schematic event meaning while staying lexically linked to their main verbs. Using contextual embeddings from UrduBERT, DunbaaBERT, and multilingual BERT on 1,126 sentences, the authors find significant representational separation between main and light uses across all verb–model pairs, yet main and light uses of the same lemma remain closer than mismatched pairs. In a seven‑way prediction task limited to light uses, UrduBERT achieves 0.866 accuracy and 0.852 macro‑F1, and maintains 0.782 accuracy when tested on unseen preceding forms, demonstrating generalization beyond local verb combinations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Computation and Language
Sep 4

Evaluating Large Language Models on Urdu Idioms

The paper introduces a new benchmark for Urdu‑to‑English idiomatic translation, featuring 4,000 manually verified sentence pairs in both native Perso‑Arabic script and Romanized Urdu. It evaluates multiple tasks—translation, paraphrasing, idiom span detection, and back‑translation—using various prompting strategies, and finds that state‑of‑the‑art large language models outperform traditional neural machine translation systems, especially in preserving figurative meaning. The study also highlights challenges posed by the lack of standardized orthography in Romanized Urdu, which affects consistency and idiom span detection.

By Muhammad Farmal Khan, Mousumi Akter
llmsnlpbenchmarks
More like this →
arXiv AI
Sep 25

Multi-Task Learning by using Contextualized Word Representations for Syntactic Parsing of a Morphologically Rich Language

The paper tackles syntactic parsing for Urdu, a morphologically rich language, and reports state‑of‑the‑art results for both constituency and dependency parsing. It introduces four key contributions: converting the CLE‑UTB phrase structure treebank into a dependency treebank with language‑specific mapping rules, a novel sequence labeling scheme that unifies the parsing task, training contextualized word representations on a 220‑million‑token Urdu corpus, and a parsing framework that employs both single‑task and multi‑task learning. Experiments show that the multi‑task setup boosts performance, achieving an F1 score of 91.39 for constituency parsing and a labeled attachment score of 85.69 for dependency parsing, improving over previous results.

By Toqeer Ehsan, Miriam Butt, Sarmad Hussain, Hassan Alhuzali, Ali Al-Laith
benchmarks
More like this →
arXiv Machine Learning
Sep 11

Multilingual in Name Only? Cultural and Linguistic Weaknesses of LLMs in Urdu

The paper investigates how multilingual large language models perform when generating stories in Urdu, a low‑resource language. The authors created a corpus of 93 Urdu stories produced by GPT‑5.1, Qwen‑3‑Max, and DeepSeek‑3.1, and manually annotated errors across a nine‑label taxonomy covering linguistic, semantic, and cultural aspects. Findings reveal frequent grammatical and semantic mistakes, lack of coherence, unnatural repetition, and pervasive cultural shallowness, with few‑shot prompting failing to resolve many of these issues.

By Farah Adeeba, Abdul Rafae Khan, Rajesh Bhatt, Hassan Sajjad
llms
More like this →