arXiv Computation and Language

Towards English - Mizo Legal Machine Translation: Corpus Creation, Analysis, and Benchmarks

The paper introduces the first English‑Mizo parallel dataset of Indian court judgments, comprising 13,168 sentence pairs from the Gauhati High Court and the Supreme Court of India. Professional native Mizo translators produced complete documents, after which sentence pairs were manually aligned and independently reviewed. Analysis reveals selective borrowing of English words—official and legal terms remain in English while everyday terms are rendered in Mizo—and inconsistent use of Mizo diacritics. Fine‑tuning the NLLB‑200 1.3B model on this corpus yields a 27.47 BLEU score on a balanced legal test set, improving by 7.16 BLEU over the base model, yet the model still over‑uses English words compared to human translation.

arXiv Computation and Language
Oct 19

Thunder-DeID+: Boundary-Aware Korean De-identification from Court Judgments to Broader Sensitive Documents

Thunder‑DeID+ is a Korean de‑identification system that improves boundary precision, label granularity, and recall when applied to court judgments and other sensitive documents. It introduces a refined three‑tier PII taxonomy and a boundary‑aware tokenizer that augments a pretrained BPE vocabulary with N‑gram and boundary‑scoring components, enabling better alignment of token and PII span boundaries. Evaluations show the tokenizer raises the W. Strict Typed F1‑score from 0.76‑0.77 to 0.87‑0.88 across models, and fine‑tuning on 1,000 broader documents yields a 0.93 score, demonstrating effective transfer beyond court judgments.

By Gyuseong Lee, Gyeongje Cho, Jongmin Kim, Heejin Kim, Yeonkyoung So, Hyunggeun Jeon, Hyunji M. Park, Sangho Kim, Yoonhee Park, Youngbin Pyo, Jaejin Lee
arXiv Computation and Language
Sep 3

CLASE: A Hybrid Method for Chinese Legalese Stylistic Evaluation

CLASE is a hybrid evaluation method for Chinese legal text that combines linguistic feature-based scores with experience-guided LLM-as-a-judge scores. It learns from contrastive pairs of authentic legal documents and their LLM-generated counterparts, enabling transparent, reference-free assessment of stylistic quality. Experiments on 200 Chinese legal documents show that CLASE aligns better with human judgments than traditional metrics and offers interpretable score breakdowns and improvement suggestions.

By Yiran Rex Ma, Yuxiao Ye, Huiyuan Xie
arXiv AI
Jun 18

TW-LegalBench: Measuring Taiwanese Legal Understanding

arXiv:2606. 18699v1 Announce Type: cross Abstract: Large language models (LLMs) have shown impressive capabilities across diverse tasks, yet their performance on jurisdiction-specific legal reasoning remains underexplored.

By Fei-Yueh Chen, Chun Huang Lin, Chan Wei Hsu, Kuan Hsuan Yeh, Zih-Ching Chen, Kuan-Ming Chen, Patrick Chung-Chia Huang
Hugging Face Trending Papers
Jul 21

AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal System

This comprehensive study introduces an advanced Artificial Intelligence for Indian Legal Question Answering (AILQA) system tailored to the Indian legal context. AILQA leverages a variety of embedding and generative models, including recent Large Language Models (LLMs), to address the unique challenges posed by the intricate and diverse nature of Indian legal texts and to enhance the accuracy and reliability of responses to legal questions.