The paper introduces a web‑data curation recipe for pretraining medical encoders, addressing the scarcity of large, diverse corpora in dense‑terminology domains like medicine. It proposes two complementary techniques: medical‑term density filtering to select documents rich in medical terminology, and signal‑amplifying rephrasing that uses an LLM to rewrite documents into denser variants with broader entity contexts. Applied to French medical NLP, the recipe produces the FineMed corpus and the DoctoBERT encoder family, achieving state‑of‑the‑art results on the DrBenchmark public benchmark and a proprietary clinical NER task.
By Bofeng Huang, Jacques Sun, Diane Bouchacourt, Nicolas Barascud, Fajwel Fogel
The paper introduces Hyperbolic Clinical Ontology Embeddings (HCOE), a method that transforms frozen BioBERT embeddings into a Poincaré ball to capture medical code hierarchies. HCOE employs ontology-guided contrastive learning and coarse‑to‑fine ontology‑path aggregation, leveraging ICD, CCS, and ATC hierarchies. Experiments on MIMIC‑IV demonstrate superior performance in clinical relation prediction, hierarchy transfer, and various predictive tasks such as mortality, readmission, medication recommendation, and rare drug prediction.
By Yixuan Li, Weihao Li, Ziyang Song
Biomedical ontology normalization maps free-text expressions to standardized concepts, enabling consistent integration and analysis of biomedical data. This task remains challenging because lexical va...
The paper proposes a behavior-based fusion model that combines large language models (LLMs) with ontology rankers to improve rare-disease diagnosis. By examining ranked lists, agreement, and ontology support, the model learns how much to rely on each system per case, achieving significant recall gains on Phenopacket Store and RAMEDIS benchmarks. Importantly, the fused diagnoses retain candidate-level ontology evidence for inspection.
By Zhaoyang Jiang, Zhizhong Fu, Yunsoo Kim, Zicheng Li, Xuanqi Peng, Fei Teng, Jiacong Mi, Honghan Wu
arXiv:2609.10055v1 Announce Type: cross
Abstract: Biomedical ontology normalization maps free-text expressions to standardized concepts, enabling consistent integration and analysis of biomedical dat...
By Jie Song, Zhichuan Xu, Ziyu Lu, Meng Xiao, Cheng Bi, Yuxin Zhang, Xin Zheng, Xiaoran Li, Qiongfang Cao, Hao Yang, Bairong Shen
arXiv:2607. 01977v1 Announce Type: new Abstract: Ontology learning (OL) aims to automatically construct structured knowledge models from text, yet progress remains fragmented across methods, domains, and evaluation practices.
By Hamed Babaei Giglou, Jennifer D'Souza, Andrei Aioanei, Nandana Mihindukulasooriya, S\"oren Auer