arXiv Machine Learning

A small HER2 reader for routine H&E slides: real-world deployment

arXiv:2610. 40662v1 Announce Type: cross Abstract: HER2 status decides who receives HER2-targeted therapy.

arXiv AI
Aug 5

A Deployment-Friendly Foundational Framework for Efficient Computational Pathology

arXiv:2602. 14010v2 Announce Type: replace-cross Abstract: Pathology foundation models (PFMs) generalize well across computational pathology tasks but remain costly for gigapixel whole-slide image analysis.

By Yu Cai, Cheng Jin, Zhengyu Zhang, Jiabo Ma, Fengtao Zhou, Yingxue Xu, Zhengrui Guo, Yihui Wang, Zhengyu Zhang, Ling Liang, Yonghao Tan, Pingcheng Dong, Du Cai, On Ki Tang, Chenglong Zhao, Zhijian Cen, Ying Tan, Xi Wang, Can Yang, Yali Xu, Jing Cui, Zhenhui Li, Ronald Cheong Kin Chan, Yueping Liu, Feng Gao, Xiuming Zhang, Li Liang, Hao Chen, Kwang-Ting Cheng
arXiv AI
Sep 4

TAP-Path: Task-Adaptive Structural and Token Pruning for Efficient and Trustworthy Pathology Foundation Models

TAP-Path is a task‑adaptive compression framework that restructures a pretrained Virchow2 encoder for histopathology. It selectively removes transformer blocks, prunes patch tokens, and adds a lightweight gated task head, reducing parameters by 24.96% and FLOPs by 35.20% while maintaining high accuracy on a 32‑class benchmark. The method achieves competitive test metrics and improved rare‑class performance, with strong external validation on CPTAC samples.

By Mehedi Hasan, Ashfak Yeafi, Md Khairul Islam
arXiv Computer Vision
Aug 27

Can You Trust Frozen Hematology Foundation Models under Acquisition Shift?

The study evaluates 15 frozen hematology foundation-model embeddings across four single‑cell acquisition domains, finding that while in‑domain accuracy is near‑saturated (macro‑F1 0.98–0.997), cross‑dataset performance drops dramatically (34–72%) and model rankings shift. Probe‑dependent rank transfer is observed, with 1‑NN retrieval more stable than linear heads, yet neither reliably predicts target robustness. Calibration deteriorates off‑domain (ECE rises from 0.004 to 0.35), and exposure to internal cohorts confounds shift analysis; a training‑free pseudo‑label‑balanced feature normalization (CBR) modestly improves target‑prior robustness and calibration. whyItMatters":"The findings highlight that frozen hematology foundation models, though accurate in‑domain, may fail under realistic scanner, site, and class‑prior shifts, underscoring the need for comprehensive audits of accuracy, calibration, exposure, and robustness before clinical deployment."

By Jai Kumar Sharma, Peeyush Tapadiya
Hugging Face Trending Papers
Aug 18

DistillPath: An Efficient 22M Distilled Pathology Encoder Approaching Large Foundation Model Performance

DistillPath-KS16 is a 22‑million‑parameter ViT‑S/16 pathology encoder distilled from larger teachers ranging from 86 M to 1.1 B parameters. By training only on the teachers’ final class and patch tokens across 6,000 public slides, it avoids costly pretraining heads and large tile corpora, yet surpasses the kaiko baseline on EVA, HEST, and PLISM benchmarks. The strongest variant, DistillPath-KS16‑Virchow2, achieves a mean EVA score of 0.795—just 0.015 points below the top model—while being 29× smaller and 25× faster.

arXiv Computer Vision
Sep 17

Lumen: Parameter-Efficient Alignment of Pretrained Vision and Language Encoders for Zero-Shot Computational Pathology

Lumen is a pathology vision‑language model that aligns frozen unimodal foundation models (Virchow2 and BioMedBERT) using rank‑4 adapters and projection heads, training only 0.40% of the total parameters on the QUILT‑1M corpus. It achieves the highest mean chance‑corrected balanced accuracy (0.546) across nine zero‑shot patch benchmarks and demonstrates strong performance on lymph‑node metastasis detection, with AUROC scores of 0.964 internally and 0.955 externally. While it ranks third in cross‑modal retrieval, Lumen’s low‑parameter training yields competitive results at both patch and slide levels.

By Kiarash Tajbakhsh, Abdelrahman Faqieh, Michael Jopiti, Javier Garcia-Baroja, Philipp Zens, Branislav Zagrapan, Yuri Tolkach, Martin D. Berger, Aurel Perren, Bastian Dislich, Inti Zlobec, Amjad Khan
arXiv Computer Vision
5d ago

Different Models, Shared Failures: Auditing Frozen-Encoder Pools for Medical Segmentation

The paper introduces CoFailMed, an audit framework that examines correlated failures among pretrained encoder pools used for medical image segmentation. By evaluating 11 public encoders across five 2D tasks with frozen features and 1×1 readouts, the study finds that models sharing checkpoints exhibit the highest per‑case Dice correlation, and that distinct checkpoints within the same encoder family are more correlated than cross‑family pairs. The analysis also shows that richer readouts and fine‑tuning can narrow but not eliminate these correlations, and that effective pool size at a 33rd‑percentile Dice threshold varies with encoder family and training recipe, underscoring the need to report absolute dependence and threshold‑specific effective size alongside accuracy.

By Eunseob Choi, Kyeonghun Kim, Hyuk-Jae Lee, Nam-Joon Kim
arXiv AI
Oct 2

On-Device Named-Entity Recognition: A Deployability Study of Accuracy, Cost, Reliability, and Confidence

The paper evaluates nine on‑device named‑entity recognition models ranging from classical taggers to large language models, measuring not only accuracy but also latency and output validity. Using a silver‑gold benchmark derived from an LLM judge panel and a human‑validated corpus, the study shows that encoder‑based models achieve comparable accuracy to a 4 B instruct LLM while being much smaller, faster, and producing no malformed output. Confidence calibration of GLiNER is analyzed, revealing over‑confidence but improved reliability after temperature scaling and thresholding.

By Vinay Kumar Chaganti
arXiv Machine Learning
Oct 22

Our Own Jev: Typed Decisions in One Forward Pass, from an In-House Judge to Open LoRA Models

arXiv:2610. 29052v1 Announce Type: cross Abstract: A typed decision maps evidence, a question and a fixed set of options to a probability for every option, computed in one forward pass, by reading a language model's logits or a small head over its hidden states, instead of generating and parsing text.

By Yuchuan Weng, Chi Liu, Xin Chen, Srinivasan Manoharan