Accurate but Natural? Diagnosing Grammatical and Idiomatic Gaps in Japanese EFL Writing
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The paper investigates Japanese past‑tense verb inflection in neural morphological generation systems, focusing on a rare irregular subtype where stems end in /e/ and require gemination before the suffix. Despite overall high accuracy (>97%), this <1% subclass accounts for 30–43% of residual errors, amplifying its impact by 34–48 times its frequency. Ablation experiments show that removing this specific subtype yields larger accuracy gains than removing all irregular verbs, highlighting the role of low‑frequency patterns and orthographic processes in error concentration.
The paper presents a retrieval‑augmented generation (RAG) system combined with prompt engineering for Japanese‑to‑Chinese translation, focusing on sentences with noun‑modifying clause constructions (NMCCs). It integrates linguistic analysis, embedding‑based retrieval, and prompt construction before generating translations with GPT‑4o, without altering the base model. Experiments on a 66‑sentence test set show that increasing the knowledge‑base size from 0 to 2,000 examples raises macro‑averaged BLEU scores from 24.28 to 29.96, indicating improved translation quality for NMCC‑rich sentences.
arXiv:2609.23573v1 Announce Type: new Abstract: Synthetic essays can help reduce dependence on human-written data in Automated Essay Scoring (AES). However, they often lack realistic errors, limiting...
arXiv:2610.08703v1 Announce Type: new Abstract: In K-12 mathematics tutoring, student-tutor dialogue provides rich evidence of learners' problem-solving processes and sources of difficulty. Learning...
The paper presents an empirical study of factual errors in human-written text, focusing on corrections in newspaper articles to build a taxonomy of common mistakes such as kanji misconversions and unit errors. It evaluates large language models’ ability to detect these errors, finding that even advanced models like GPT‑5.4 achieve only a 52% word‑level F1 score on synthetic data, underscoring the difficulty of the task. The work highlights the gap in research on factual error detection in human writing compared to LLM hallucinations.
The paper introduces a layered taxonomy for annotating grammatical errors in Chinese learner writing, aiming for consistency and linguistic relevance. It first classifies character- and punctuation-level orthographic errors by edit operation and subtype, then assigns other errors a three-layer core label that combines edit operation, linguistic domain, and part of speech, with optional Chinese-specific extensions. The taxonomy is evaluated through coverage analysis of automatically extracted edits and a preliminary consistency study using five large language models, confirming the layered approach while highlighting areas needing refinement.