CSWBench: Evaluating Context-Sensitive Code-Switching in Creative Writing
Read the original on arXiv Computation and Language →CSWBench is a benchmark designed to evaluate context-sensitive code-switching in creative writing, featuring two settings: Focused Narrative and Extended Narrative. The accompanying CSWEval framework assesses event-level aspects such as Licensing, Contextual Appropriateness, and Functional Gain, as well as whole-text quality metrics tailored to each narrative setting. Experiments with twelve large language models reveal that while models show some code-switching competence, performance varies significantly across narrative contexts, with stronger challenges in multilingual literary integration and clearer associations between narratively salient switches and contextual/functional realization.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.