arXiv Machine Learning By Saroj Khanal, Yashawant Kumar Yadav, Kritam Bhattarai, Jeevan Neupane, Shristi Subedi, Saship Gwachha, Manish Kumar Tiwari, Dong Zhang, Confidence Raymond, Aondona Moses Iorumbur, Udunna Anazodo, Surendra Maharjan, Bishesh Khanal, Mahesh Shakya, Pralhad Kumar Shrestha

Large-Scale Pretraining for Improving Deep Learning-Based Geometric Distortion Correction of Diffusion-Weighted Imaging

Read the original on arXiv Machine Learning →

The paper explores large‑scale pretraining to enhance deep learning‑based geometric distortion correction for diffusion‑weighted imaging (DWI). By framing the task as image reconstruction, the authors compare a non‑pretrained baseline with self‑supervised and generative pretrained models, finding that the cWDM model yields the best quantitative and qualitative results. When applied to low‑resource, high‑throughput settings in a low‑ and middle‑income country, the pretrained models faced transferability issues, but aligning images to a common standard space improved predictions, indicating that harmonized preprocessing can aid cross‑domain deployment.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 19

Data-Efficient Classifier Pretraining Through Diffusion Models

The paper introduces DiffPT, a diffusion‑based pretraining method for classifier backbones aimed at improving performance when training data is scarce. Experiments on time‑series, natural image, and medical imaging datasets show that DiffPT outperforms many self‑supervised baselines, especially in low‑data regimes for medical and time‑series tasks. While contrastive pretraining remains superior on CIFAR‑10 and Tiny ImageNet, DiffPT offers a simple and effective alternative across diverse modalities.

By Qinyu Li, Yee Whye Teh, Chris Holmes, Joel Jaskari