arXiv Machine Learning October 22, 2026 By Sonja Topf, Ana Sanchez-Fernandez, G\"unter Klambauer

BatchBench: Benchmarking AI Robustness to Batch Effects and Domain Shift in Biomedical Images - A JUMP Cell Painting Leaderboard

Read the original on arXiv Machine Learning →

BatchBench is a new leaderboard designed to assess AI robustness to batch effects and domain shift in biomedical images. It evaluates performance on unseen experimental batches and data sources using the large JUMP-CP dataset, which is generated via the Cell Painting assay and exhibits pronounced batch effects. The benchmark aims to highlight remaining performance gaps despite recent domain adaptation advances.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision

Sep 1

JUMP-lite: Compact, reproducible benchmarking of cell representations

arXiv:2608.07632v2 Announce Type: replace-cross Abstract: Image-based profiling captures rich phenotypic signatures for drug discovery and functional genomics. Large public datasets like JUMP Cell Pa...

By Al\'an F. Mu\~noz, Johan Fredin Haslum, Runxi Shen, Anne E. Carpenter, Shantanu Singh

benchmarks

arXiv Computer Vision

Aug 25

Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline

The paper introduces an agentic AI Scientist workflow that automates the entire baseline development process for medical imaging by combining literature-guided reasoning, automated code generation, and hypothesis-driven experimentation. Evaluated on four public benchmarks covering segmentation, classification, and detection, the pipeline consistently improves validation performance, achieving competitive leaderboard results such as 6th place on both PUMA tracks and 31st on MILK10k. The approach also shows strong domain generalization on MIDOG25 across scanners, tumor types, and species, demonstrating that a skill-based, literature-guided agentic workflow can reduce engineering effort without task-specific redesign.

By Eugenia Moris, Jos\'e Ignacio Orlando

agents computer-vision benchmarks

arXiv Computer Vision

Aug 25

Few-Shot Cross-Dataset Adaptation for Tuberculosis Detection Using DenseNet

arXiv:2608.21427v1 Announce Type: new Abstract: Tuberculosis (TB) is one of the most common and dangerous bacterial ailments. Every year, it causes a large number of deaths worldwide. Although many d...

By Bidhan Biswas, Shahadat Hossain Sohag, Nabil Ashab, Soumit Kumar Kundu, Saif Mahmud Parvez

fine-tuning

arXiv Computer Vision

Sep 10

Semi-Supervised Domain Adaptation with Latent Diffusion for Pathology Image Classification

arXiv:2601.17228v2 Announce Type: replace Abstract: Deep learning models in computational pathology often fail to generalize across cohorts and institutions due to domain shift. Existing approaches e...

By Tengyue Zhang, Ruiwen Ding, Luoting Zhuang, Yuxiao Wu, Erika F. Rodriguez, William Hsu

diffusion computer-vision fine-tuning

arXiv Computer Vision

Sep 1

On the Role of MRI Sequences in Cross-Dataset Generalization for Brain Tumor Segmentation

arXiv:2608.29944v1 Announce Type: new Abstract: Brain tumor segmentation in magnetic resonance imaging (MRI) is a critical task for diagnosis and treatment planning. Despite the success of deep learn...

By Henrique Zan Grande, Jo\~ao G. Pitol, Lucas B. Schuck, Rafael V. Serenato, Rayson Laroca, Andre Gustavo Hochuli

computer-vision fine-tuning

arXiv AI

Sep 1

MedSegBenchmarker: A Raw-Count-First Framework for Controlled 2D Medical Image Segmentation Benchmarks

arXiv:2608.29677v1 Announce Type: cross Abstract: Despite rapid advances in MIS, fair and reproducible comparisons of segmentation models remain challenging due to heterogeneous datasets, inconsisten...

By Vanessa Borst, Lukas Horn, Daniel Grillmeyer, Thomas Prantl, Samuel Kounev

computer-vision benchmarks

One email a morning, machine-written

Related stories

JUMP-lite: Compact, reproducible benchmarking of cell representations

Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline

Few-Shot Cross-Dataset Adaptation for Tuberculosis Detection Using DenseNet

Semi-Supervised Domain Adaptation with Latent Diffusion for Pathology Image Classification

On the Role of MRI Sequences in Cross-Dataset Generalization for Brain Tumor Segmentation

MedSegBenchmarker: A Raw-Count-First Framework for Controlled 2D Medical Image Segmentation Benchmarks