arXiv AI
Audit Before You Distill: A Controlled Workflow for Reasoning Transfer into Compact Medical Language Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
Sep 22
When Quantization Preserves Accuracy but Not Evidence: Explanation-Aware Post-Training Quantization for Medical LLMs
arXiv:2609.24799v1 Announce Type: new Abstract: Post-training quantization (PTQ) enables efficient deployment of large language models, and PTQ methods are usually optimized and evaluated with generi...
arXiv AI
Oct 15
MedEvo: Medical Reasoning Evolution through Knowledge Navigation
arXiv:2610.17690v1 Announce Type: new Abstract: Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed traje...
Hugging Face Trending Papers
Oct 13
MedEvo: Medical Reasoning Evolution through Knowledge Navigation
Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed trajectories, while general-domain correction methods...
arXiv AI
Oct 9
Data-Free On-Policy Distillation: How Far Can We Go Without External Data?
The paper investigates how much training data is required for on‑policy distillation (OPD) of foundation models. It shows that in two single‑teacher settings, only eight real prompts can match the performance of 17,000 problems, and that 64 self‑generated questions can replace full external datasets. In multi‑teacher scenarios, 1,000 generated questions achieve comparable results to 7,000 real examples, while fully implicit question generation works only in limited cases.
arXiv Computation and Language
Sep 10
Which Medical Questions Deserve Rationales? Perturbation-Sensitive Selection for Robust QA
arXiv:2609.09684v1 Announce Type: new Abstract: Medical question-answering datasets often contain answer labels, whereas high-quality rationales remain scarce, noisy, or costly to validate. This chan...
arXiv AI
2d ago
Ask to Distill: Learning to Synthesize Data for On-Policy Distillation
arXiv:2610.27450v1 Announce Type: new Abstract: On-policy distillation (OPD) can succeed with surprisingly few training questions, motivating a view of questions as carriers of distributional knowled...