Natural language processing

Classical and neural NLP: translation, question answering, tokenization and the evaluation of language understanding.

2,564 stories · RSS feed

arXiv Computation and Language
4d ago

TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs

The paper introduces TriageRA-CCF, a method for adaptively allocating low‑rank LoRA channels in medical large language models based on source‑side signals: answer confidence, clinical coverage, and a counterfactual close‑miss proxy. By supervising a budget router that selects among 2, 4, or 8 active ranks, the approach improves average accuracy over existing LoRA variants on Qwen3‑8B and Llama3.1‑8B, though gains vary across benchmarks. Ablation studies confirm that each signal contributes to better budget decisions, though their combined effect is not uniformly superior across all backbones.

By Shucan Ji, Yining Huang, Hongliang Guo
arXiv Computation and Language
4d ago

Bridging Semantic Gaps in RAG through Generated Context Knowledge Fusion

The paper introduces Knowledge-Aware Semantic Bridging (KASB), a framework designed to improve Retrieval-Augmented Generation (RAG) by aligning the semantic spaces of queries and retrieved contexts. KASB achieves this through intelligent fusion of generative and retrieval-based knowledge in a multistage process, aiming to enhance passage selection quality, relevance, and accuracy. The authors evaluate the method on three popular open-domain Question Answering datasets, demonstrating its effectiveness.

By Xinkai Du, Chao Lv, Yalin Sun, Quanjie Han, Lei Yao, Maosong Sun
arXiv Computer Vision
4d ago

RS-OPSD: Reliable Privileged On-Policy-Self-Distillation for Ultra-High-Resolution Remote Sensing VQA

The paper introduces RS-OPSD, a reliable privileged on-policy self-distillation framework designed for ultra‑high‑resolution remote sensing visual question answering. It leverages a new dataset, GeoEvidence‑6K, and a human‑feedback guided skill refinement process to provide explicit question‑relevant evidence. By incorporating context‑preserving visual privilege and correctness‑aligned distillation, RS‑OPSD achieves state‑of‑the‑art performance on several benchmarks without requiring additional visual search or tool calls at inference time.

By Chengjie Jiang, Yunqi Zhou, Jiafeng Yan, Sihang Zhao, Chun Yuan, Jing Li
arXiv AI
4d ago

FLOORA: A Human-Aligned Domain-Specific Language Model for Architectural Design

arXiv:2609.36064v1 Announce Type: cross Abstract: Foundation models are powerful generators, but many engineering domains require structured representations that general-purpose systems handle poorly...

By Sahand Rezaei-Shoshtari, Patryk Wozniczka, Shu Ishida, Gregg Streuber, Farnoosh Javadi, Jeffrey Landes, Angela Ju, Muhammad Azam, Bryan Lim, Johan Luttun, Indrajeet Haldar, Jonathan Shaw, Beatriz Guerra, Ivan Sosnovik, James Stoddart, Robert Giaquinto, Adam Gaier
arXiv AI
4d ago

Geometry-Conditioned Fixed-Scaffold Encoders for Time-Warp Robust Sequence Retrieval

The paper introduces GeoPatch, a fixed‑scaffold patch encoder that decouples token support from signal geometry for time‑warp robust sequence retrieval. By using geometry‑derived descriptors (slope, curvature, acceleration, affine‑residual, confidence) as continuous conditioning variables, GeoPatch prevents patch boundary drift while still allowing geometry to modulate embeddings. Experiments on ECG, speech, and multivariate time‑series data show that GeoPatch improves early‑rank retrieval under timing variation and highlights a trade‑off between local surface matching and strict non‑overlap retrieval.

By Cassandra Yang, Yufan Tang
arXiv AI
4d ago

SkillCome: Group Contrast Skill Optimization with Dual Memory

SkillCome introduces a skill-evolution framework that uses group contrast optimization and a dual memory system to refine large language model skills. By generating multiple trajectories per question and contrasting successful versus failed ones, it identifies key behavioral divergences to guide skill edits. The dual memory accumulates historical evidence across groups, enabling more generalized and reliable optimization signals, leading to consistent performance gains on diverse benchmarks.

By Haolin Li, Feng Hong, Ang Li, Chilin Fu, Weichang Wu, Ya Zhang, Yanfeng Wang, Xiaolu Zhang, Jiangchao Yao
arXiv Computation and Language
4d ago

IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models

arXiv:2602.05385v2 Announce Type: replace Abstract: Text-to-SQL is a key natural language processing task that maps natural language questions to SQL queries, enabling intuitive interaction with web-...

By Tao Liu, Jiafan Lu, Bohan Yu, Pengcheng Wu, Liu Haixin, Guoyu Xu, Li Xiangheng, Lixiao Li, Jiaming Hou, Zhao Shijun, Xinglin Lyu, Kunli Zhang, Yuxiang Jia, Hongyin Zan