arXiv Computation and Language

A Hybrid Hierarchical 1D-CNN-BiLSTM Framework for Extractive Summarization of Biomedical and Clinical Text

arXiv AI
Oct 5

RASPER: Reward-Aligned Summarization of Clinical Notes for EHR Outcome Prediction

RASPER is a reward‑aligned summarizer that tailors the extraction of information from unstructured discharge notes to improve downstream clinical predictions. It uses a tunable LLM summarizer trained with reinforcement learning, where the reward comes from the loss of a downstream predictor, and incorporates patient‑specific context via a longitudinal encoder that soft‑prompts the summarizer with structured codes. The approach consistently outperforms strong baselines on readmission prediction and medication recommendation tasks in the MIMIC‑III and MIMIC‑IV datasets.

By Arya Hadizadeh Moghaddam, Mohsen Nayebi Kerdabadi, Chen Chen, Dongjie Wang, Zijun Yao
arXiv Computation and Language
2d ago

ShiftRAG: Bypassing the Textual Bottleneck via Decoupled Learning and Continuous Soft Tokens

ShiftRAG is a new retrieval‑augmented generation framework that decouples discriminative retrieval learning from autoregressive generation while still using a single LLM backbone. It addresses the textual bottleneck of existing RAG pipelines by projecting retrieval alignments into continuous soft tokens, creating a high‑bandwidth interface that feeds retrieval signals into the generator. The approach also introduces a soft orthogonality objective to reduce rank collapse and layer‑wise relevance dynamics to preserve fine‑grained latent space, resulting in significant improvements in retrieval and question‑answering performance over state‑of‑the‑art baselines.

By Youmin Ko, Jihong Jeong, Hyunjoon Kim
Hugging Face Trending Papers
Jul 20

Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shift

We propose Token-Level Off-Policy Labeling (TOPL), an off-policy training paradigm that reframes post-training as a token-level correctness prediction task. Our key intuition is that by training the model to distinguish good and bad tokens in a response, we naturally guide the model towards generating good tokens, while avoiding the pitfalls that come with directly training the model to generate off-policy tokens.

Hugging Face Trending Papers
Jun 17

SenFlow: Inter-Sentence Flow Modeling for AI-Generated Text Detection in Hybrid Documents

Sentence-level AI-generated text detection (S-AGTD) for hybrid documents, where humans and LLMs co-author one text, faces two gaps: existing methods classify each sentence in isolation, discarding inter-sentence dependencies, and existing benchmarks omit the newest generation of generators. We construct MOSAIC, a benchmark of 16,000 hybrid documents over PubMed and XSum, generated by DeepSeek-V3.

arXiv Computation and Language
Oct 23

From Structured Records to Patient Narratives: Preserving Clinical Alignment in LLM-Generated Health Summaries

The paper explores how Large Language Models can translate structured clinical data into patient-friendly narratives while maintaining clinical accuracy. Using a constrained generation framework that blends evidence conditioning with Retrieval-Augmented Generation, the authors evaluate alignment through Natural Language Inference, factuality metrics, and readability. Their results show that grounding constraints improve clinical alignment and uncertainty preservation across three LLMs, though they may increase reading difficulty and medical terminology.

By Bayram Ayadi, Florian Geissler, Johanna Schmidhuber